Flume use of multiplexing channel selector

Question

I am trying to implement flume to ingest the data around 1TB. For this I am trying to use the multiplexing channel selector.

There are some examples available that shows how to use the multiplexing channel selector.

My question is how one can determine the header content of an event?

For example, in below configuration, I am using multiplexing channel selector with header as State and mapping is made to CN, ID, IN etc.

spoolDirAgent.sources.source1.selector.type = multiplexing
spoolDirAgent.sources.source1.selector.header = State
spoolDirAgent.sources.source1.selector.mapping.CN = channel1
spoolDirAgent.sources.source1.selector.mapping.IN = channel2
spoolDirAgent.sources.source1.selector.mapping.ID = channel2
spoolDirAgent.sources.source1.selector.defalut = channel1

Also if possible, please let me know how to use the event headers in flume sources?

Thanks in advance!

Answer 1

as the flume-ng user guide indicated, if the event header doesn't contain key 'State', then the default channel will be used. and search "static interceptor" in flume-ng user guide, then more or less you'll know how to add key 'State' into the header.