admin管理员组

文章数量:1642243

Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to send events
at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:389)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flume.EventDeliveryException: NettyAvroRpcClient { host: vm-bw-server17, port: 5858 }: Failed to send batch
at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:314)
at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:373)
… 3 more
Caused by: org.apache.flume.EventDeliveryException: NettyAvroRpcClient { host: vm-bw-server17, port: 5858 }: Interrupted in handshake
at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:361)
at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:302)
… 4 more
Caused by: java.lang.InterruptedException
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:404)
at java.util.concurrent.FutureTask.get(FutureTask.java:204)
at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:356)
… 5 more

用的双层flume拓扑结构
第一层采集，第二层自定义flume2将flume1的数据汇聚分别发送至kafka和hbase，结果flume2只能收到5条数据，关掉flume1报上述错误。改了半天最后把参数修改了就对了
a2.sources = r2
a2.sinks = k2
a2.channels = c2

a2.sources.r2.type = exec
a2.sources.r2mand =tail -F /opt/data/date/weblog-flume.log

a2.channels.c2.type = memory
a2.channels.c2.capacity = 1000
a2.channels.c2.transactionCapacity = 1000
//修改的地方
a2.channel.byteCapacityBufferPercentage = 20
a2.memoryChannel.byteCapacity = 800000
a2.memoryChannel.keep-alive = 60
a2.memoryChannel.capacity = 1000000

a2.sinks.k2.type = avro
a2.sinks.k2.hostname = vm-bw-server17
a2.sinks.k2.port = 5858

a2.sources.r2.channels = c2
a2.sinks.k2.channel = c2

本文标签： 报错flume

版权声明：本文标题：flume报错 内容由热心网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：https://www.elefans.com/dongtai/1729332936a1196626.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。