欢迎关注大数据技术架构与案例微信公众号:过往记忆大数据
过往记忆博客公众号iteblog_hadoop
欢迎关注微信公众号:
过往记忆大数据

Flume内置channel,source,sink汇总

由于经常会使用到Flume的一些channel,source,sink,于是为了方便将这些channel,source,sink汇总出来,也共大家访问。

Component InterfaceType AliasImplementation Class
*.Channelmemory*.channel.MemoryChannel
*.Channeljdbc*.channel.jdbc.JdbcChannel
*.Channelfile*.channel.file.FileChannel
*.Channel*.channel.PseudoTxnMemoryChannel
*.Channelorg.example.MyChannel
*.Sourceavro*.source.AvroSource
*.Sourcenetcat*.source.NetcatSource
*.Sourceseq*.source.SequenceGeneratorSource
*.Sourceexec*.source.ExecSource
*.Sourcesyslogtcp*.source.SyslogTcpSource
*.Sourcemultiport_syslogtcp*.source.MultiportSyslogTCPSource
*.Sourcesyslogudp*.source.SyslogUDPSource
*.Sourcespooldir*.source.SpoolDirectorySource
*.Sourcehttp*.source.http.HTTPSource
*.Sourcethrift*.source.ThriftSource
*.Sourcejms*.source.jms.JMSSource
*.Source*.source.avroLegacy.AvroLegacySource
*.Source*.source.thriftLegacy.ThriftLegacySource
*.Sourceorg.example.MySource
*.Sinknull*.sink.NullSink
*.Sinklogger*.sink.LoggerSink
*.Sinkavro*.sink.AvroSink
*.Sinkhdfs*.sink.hdfs.HDFSEventSink
*.Sinkhbase*.sink.hbase.HBaseSink
*.Sinkasynchbase*.sink.hbase.AsyncHBaseSink
*.Sinkelasticsearch*.sink.elasticsearch.ElasticSearchSink
*.Sinkfile_roll*.sink.RollingFileSink
*.Sinkirc*.sink.irc.IRCSink
*.Sinkthrift*.sink.ThriftSink
*.Sinkorg.example.MySink
*.ChannelSelectorreplicating*.channel.ReplicatingChannelSelector
*.ChannelSelectormultiplexing*.channel.MultiplexingChannelSelector
*.ChannelSelectororg.example.MyChannelSelector
*.SinkProcessordefault*.sink.DefaultSinkProcessor
*.SinkProcessorfailover*.sink.FailoverSinkProcessor
*.SinkProcessorload_balance*.sink.LoadBalancingSinkProcessor
*.SinkProcessor
*.interceptor.Interceptortimestamp*.interceptor.TimestampInterceptor$Builder
*.interceptor.Interceptorhost*.interceptor.HostInterceptor$Builder
*.interceptor.Interceptorstatic*.interceptor.StaticInterceptor$Builder
*.interceptor.Interceptorregex_filter*.interceptor.RegexFilteringInterceptor$Builder
*.interceptor.Interceptorregex_extractor*.interceptor.RegexFilteringInterceptor$Builder
*.channel.file.encryption.
KeyProvider$Builder
jceksfile*.channel.file.encryption.JCEFileKeyProvider
*.channel.file.encryption.
KeyProvider$Builder
org.example.MyKeyProvider
*.channel.file.encryption.CipherProvideraesctrnopadding*.channel.file.encryption.AESCTRNoPaddingProvider
*.channel.file.encryption.CipherProviderorg.example.MyCipherProvider
*.serialization.EventSerializer$Buildertext*.serialization.BodyTextEventSerializer$Builder
*.serialization.EventSerializer$Builderavro_event*.serialization.FlumeEventAvroEventSerializer$Builder
*.serialization.EventSerializer$Builderorg.example.MyEventSerializer$Builder
由于表格太大了,所以这里将org.apache.flume.替换为*.,读者在阅读的时候,直接将*.理解成org.apache.flume.即可!

Sinks

accumulator
agentBEChain
agentBESink
agentBestEffortSink
agentDFOChain
agentDFOSink
agentE2EChain
agentE2ESink
agentFailoverSink
agentSink
attr2hbase
autoBEChain
autoDFOChain
autoE2EChain
avroSink
collectorSink
console
counter
counterHistory
customdfs
dfs
escapedCustomDfs
escapedFormatDfs
fail
failChain
flightbookinghbase
flightsearchhbase
formatDfs
ganglia
hbase
irc
logicalSink
multigrep
multigrepspec
null
regexhisto
regexhistospec
rpcSink
seqfile
syslogTcp
text
thriftSink

Sources

asciisynth
autoCollectorSource
avroSource
collectorSource
console
exec
execPeriodic
execStream
fail
irc
log4jfile
logicalSource
multitail
nonlsynth
null
report
rpcSource
scribe
seqfile
stdin
synth
synthrndsize
syslogTcp
syslogTcp1
syslogUdp
tail
tailDir
text
thriftSource
tpriosource
twitter

Decorators

AccessIpFormatFilter
AmendAccessLogNew
AmendNginxErrorLog
ApacheFilter
CatalinaFormat
CatalinaLogExceptionFilter2
CatalinaLogExceptionFilter3
CatalinaLogFilter2
CatalinaLogFilter3
FieldEqValueFilter
Filter
FormatAccessLog
FormatDate
LogExceptionFilter
LogFilter
PhpFilter
ackChecker
ackInjector
ackedWriteAhead
amendAccessLog
batch
benchinject
benchreport
bloomCheck
bloomGen
choke
delay
digest
diskFailover
exDate
flakeyAppend
format
gunzip
gzip
inmem
insertBefore
insistentAppend
insistentOpen
intervalDroppyAppend
intervalFlakeyAppend
intervalSampler
lazyOpen
mask
mult
nullDeco
probSampler
regex
regexAll
reservoirSampler
select
split
splitCompare
stubbornAppend
unbatch
value
本博客文章除特别声明,全部都是原创!
原创文章版权归过往记忆大数据(过往记忆)所有,未经许可不得转载。
本文链接: 【Flume内置channel,source,sink汇总】(https://www.iteblog.com/archives/948.html)
喜欢 (13)
分享 (0)
发表我的评论
取消评论

表情
本博客评论系统带有自动识别垃圾评论功能,请写一些有意义的评论,谢谢!