none
send data from local directory in a linux VM with flume to a directory of the data lake store

    Question

  • Hello guyz,

    Here is my flume conf file with agent name a1 i don't what type of sink to use to reach the data lake store 

    thanks

    a1.sources = r1
    a1.sinks = k1
    a1.channels = c1
    
    # Describe/configure the source
    a1.sources.r1.type = spooldir
    a1.sources.r1.spoolDir = home/
    a1.sources.r1.fileHeader = true
    
    #escribe the sink
    a1.sinks.k1.type = 
    a1.sinks.k1.directory = 
    
    
    
    # Use a channel which buffers events in memory
    a1.channels.c1.type = memory
    a1.channels.c1.capacity = 1000
    a1.channels.c1.transactionCapacity = 100
    
    # Bind the source and sink to the channel
    a1.sources.r1.channels = c1
    a1.sinks.k1.channel = c1


    • Edited by max76000 Tuesday, November 20, 2018 11:29 AM
    Tuesday, November 20, 2018 11:28 AM

All replies