flume配置文件如下:
# Name the components on this agent app1.sources = r1 app1.sinks = k1 app1.channels = c1 # Describe/configure the source app1.sources.r1.type = avro app1.sources.r1.bind = 0.0.0.0 app1.sources.r1.port = 44444 # Describe the sink #a1.sinks.k1.type = logger app1.sinks.k1.type = file_roll app1.sinks.k1.sink.directory = /var/log/my/app1 app1.sinks.k1.sink.rollInterval=86400 app1.sinks.k1.sink.batchSize=100 app1.sinks.k1.sink.serializer=text app1.sinks.k1.sink.serializer.appendNewline = false # Use a channel which buffers events in memory app1.channels.c1.type = memory app1.channels.c1.capacity = 1000 app1.channels.c1.transactionCapacity = 100 app1.channels.c1.byteCapacity = 100000000 app1.channels.c1.byteCapacityBufferPercentage = 10 # Bind the source and sink to the channel app1.sources.r1.channels = c1 app1.sinks.k1.channel = c1 # Name the components on this agent app2.sources = r2 app2.sinks = k2 app2.channels = c2 # Describe/configure the source app2.sources.r2.type = avro app2.sources.r2.bind = 0.0.0.0 app2.sources.r2.port = 44445 # Describe the sink #a1.sinks.k1.type = logger app2.sinks.k2.type = file_roll app2.sinks.k2.sink.directory = /var/log/my/app2 app2.sinks.k2.sink.rollInterval=86400 app2.sinks.k2.sink.batchSize=100 app2.sinks.k2.sink.serializer=text app2.sinks.k2.sink.serializer.appendNewline = false # Use a channel which buffers events in memory app2.channels.c2.type = memory app2.channels.c2.capacity = 1000 app2.channels.c2.transactionCapacity = 100 app2.channels.c2.byteCapacity = 100000000 app2.channels.c2.byteCapacityBufferPercentage = 10 # Bind the source and sink to the channel app2.sources.r2.channels = c2 app2.sinks.k2.channel = c2
dockerfile如下:
FROM ubuntu:16.04 MAINTAINER XXX "XXX@XXXXX.com" RUN apt-get update ADD jdk-8u77-linux-x64.tar.gz /usr/local/java RUN cp /etc/profile /etc/profile.bak ENV JAVA_HOME /usr/local/java/jdk1.8.0_77 ENV PATH $JAVA_HOME/bin:$PATH ENV CLASSPATH .:$JAVA_HOME/lib ADD apache-flume-1.7.0-bin.tar.gz /usr/local/flume RUN apt-get install -y tzdata RUN ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime RUN echo "Asia/Shanghai" > /etc/timezone RUN dpkg-reconfigure -f noninteractive tzdata ENV LANG C.UTF-8 WORKDIR /var/log RUN mkdir my WORKDIR /var/log/my RUN mkdir app1 RUN mkdir app2 EXPOSE 44444 EXPOSE 44445 ENTRYPOINT (/usr/local/flume/apache-flume-1.7.0-bin/bin/flume-ng agent --conf /usr/local/flume/apache-flume-1.7.0-bin/conf -conf-file /usr/local/flume/apache-flume-1.7.0-bin/conf/flume-conf.properties --name app1 &) && (/usr/local/flume/apache-flume-1.7.0-bin/bin/flume-ng agent --conf /usr/local/flume/apache-flume-1.7.0-bin/conf -conf-file /usr/local/flume/apache-flume-1.7.0-bin/conf/flume-conf.properties --name app2 &) && /bin/bash
下面看下flume 启动不输出运行日志
问题
以前碰到的一个问题,算是一个小问题,flume 用命令
./flume-ng agent -c /opt/apps/flume/conf -f /opt/apps/flume/conf/syslog_tcp.conf -n a1 -Dflume.root.logger=INFO,console
启动的时候,flume使用的log4j不起效,不会输出日志到日志文件。
解决
在启动时去掉
-Dflume.root.logger=INFO,console
这个命令就好了。flume的log4j就正常工作了。也算是一个坑。
加上这个命令会将运行的日志在控制台输出。
总结
以上所述是小编给大家介绍的 Docker容器中运行flume及启动不输出运行日志问题,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对网站的支持!
免责声明:本站文章均来自网站采集或用户投稿,网站不提供任何软件下载或自行开发的软件!
如有用户或公司发现本站内容信息存在侵权行为,请邮件告知! 858582#qq.com
白云城资源网 Copyright www.dyhadc.com
暂无“Docker容器中运行flume及启动不输出运行日志问题”评论...
更新日志
2024年12月23日
2024年12月23日
- 小骆驼-《草原狼2(蓝光CD)》[原抓WAV+CUE]
- 群星《欢迎来到我身边 电影原声专辑》[320K/MP3][105.02MB]
- 群星《欢迎来到我身边 电影原声专辑》[FLAC/分轨][480.9MB]
- 雷婷《梦里蓝天HQⅡ》 2023头版限量编号低速原抓[WAV+CUE][463M]
- 群星《2024好听新歌42》AI调整音效【WAV分轨】
- 王思雨-《思念陪着鸿雁飞》WAV
- 王思雨《喜马拉雅HQ》头版限量编号[WAV+CUE]
- 李健《无时无刻》[WAV+CUE][590M]
- 陈奕迅《酝酿》[WAV分轨][502M]
- 卓依婷《化蝶》2CD[WAV+CUE][1.1G]
- 群星《吉他王(黑胶CD)》[WAV+CUE]
- 齐秦《穿乐(穿越)》[WAV+CUE]
- 发烧珍品《数位CD音响测试-动向效果(九)》【WAV+CUE】
- 邝美云《邝美云精装歌集》[DSF][1.6G]
- 吕方《爱一回伤一回》[WAV+CUE][454M]