【问题标题】:Cygnus stop at start天鹅座在开始时停止
【发布时间】:2015-05-19 17:54:47
【问题描述】:

我已经使用this guide 在 Ubuntu 14.04 上安装了 Cygnus,当我继续通过(正确填写)启动 cygnus 时:

nohup APACHE_FLUME_HOME/bin/cygnus-flume-ng agent --conf APACHE_FLUME_HOME/conf -f APACHE_FLUME_HOME/conf/cygnus.conf -n cygnusagent -Dflume.root.logger=INFO,LOGFILE [-p <mgmt-if-port>] [-t <polling-interval>] &

我得到这个输出:

 Warning: JAVA_HOME is not set!

+ exec /usr/bin/java -Xmx20m -cp '/etc/flume/apache-flume-1.4.0-bin/conf:/etc/flume/apache-flume-1.4.0-bin/lib/*:/etc/flume/apache-flume-1.4.0-bin/plugins.d/cygnus/lib/*'

-Djava.library.path= com.telefonica.iot.cygnus.nodes.CygnusApplication -f /usr/cygnus/conf/agent_1.conf -n cygnusagent 

Starting an ordered shutdown of Cygnus 
Stopping sources
All the channels are empty
Stopping channels Stopping sinks

问题出在哪里?

版本:0.8.0

会议。文件:

cygnusagent.channel = mysql-channel
cygnusagent.sinks = mysql-sink
cygnusagent.sources = http-source

cygnusagent.sources.http-source.channels = mysql-channel
cygnusagent.sources.http-source.type = org.apache.flume.source.http.HTTPSource
cygnusagent.sources.http-source.port = 5050
cygnusagent.sources.http-source.handler = es.tid.fiware.fiwareconnectors.cygnus.handlers.OrionRestHandler
cygnusagent.sources.http-source.handler.notification_target = /notify
cygnusagent.sources.http-source.handler.default_service = def_serv
cygnusagent.sources.http-source.handler.default_service_path = def_servpath
cygnusagent.sources.http-source.handler.events_ttl = 10
cygnusagent.sources.http-source.interceptors = ts de
cygnusagent.sources.http-source.interceptors.ts.type = timestamp
cygnusagent.sources.http-source.interceptors.de.type = es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor$Builder
cygnusagent.sources.http-source.interceptors.de.matching_table = /usr/cygnus/conf/matching_table.conf

cygnusagent.sinks.mysql-sink.channel = mysql-channel
cygnusagent.sinks.mysql-sink.type = es.tid.fiware.fiwareconnectors.cygnus.sinks.OrionMySQLSink
cygnusagent.sinks.mysql-sink.mysql_host = 127.0.0.1
cygnusagent.sinks.mysql-sink.mysql_port = 3306
cygnusagent.sinks.mysql-sink.mysql_username = root
cygnusagent.sinks.mysql-sink.mysql_password = root
cygnusagent.sinks.mysql-sink.attr_persistence = row

cygnusagent.channels.mysql-channel.type = memory
cygnusagent.channels.mysql-channel.capacity = 1000
cygnusagent.channels.mysql-channel.transactionCapacity = 100

日志:

2015-05-20 18:51:59,475(主要)[信息- com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:235)] 启动 Jetty 服务器监听 8081 端口(管理接口)

2015-05-20 18:51:59,519(主要)[信息- org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] 登录到 org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) 通过 org.mortbay.log.Slf4jLog

2015-05-20 18:51:59,519(主要)[信息- com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:238)] 启动 Cygnus 应用程序

2015-05-20 18:51:59,528(线程 1)[信息- org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] jetty-6.1.26

2015-05-20 18:51:59,544 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] 配置提供程序启动

2015-05-20 18:51:59,559 (conf-file-poller-0) [信息- org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] 重新加载配置 文件:/etc/flume/apache-flume-1.4.0-bin/conf/cygnus.conf

2015-05-20 18:51:59,575 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,588 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,588 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,589 (conf-file-poller-0) [警告- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] 指定的属性无效:频道

2015-05-20 18:51:59,592 (conf-file-poller-0) [警告- org.apache.flume.conf.FlumeConfiguration.(FlumeConfiguration.java:101)] 配置属性被忽略:cygnusagent.channel = mysql-channel

2015-05-20 18:51:59,593 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,593 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:930)] 添加接收器:mysql-sink 代理:cygnusagent

2015-05-20 18:51:59,594 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,594 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,594 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] 处理:mysql-sink

2015-05-20 18:51:59,621 (conf-file-poller-0) [警告- org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:319)] “cygnusagent”的代理配置不包含任何通道。 将其标记为无效。

2015-05-20 18:51:59,621 (conf-file-poller-0) [警告- org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127)] 代理“cygnusagent”的代理配置无效。这将是 删除。

2015-05-20 18:51:59,622 (conf-file-poller-0) [信息- org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:140)] 验证后水槽配置包含代理的配置: []

2015-05-20 18:51:59,622 (conf-file-poller-0) [警告- org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:138)] 找不到此主机的配置:cygnusagent

2015-05-20 18:51:59,640(线程 1)[警告 - org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] 失败 SocketConnector@0.0.0.0:8081: java.net.BindException: 地址已经 正在使用中

2015-05-20 18:51:59,652(线程 1)[警告- org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] 失败 Server@62526d1d: java.net.BindException: 地址已在使用中

2015-05-20 18:51:59,652(线程 1)[致命 - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] 运行管理界面的致命错误。详细信息=地址已经 正在使用中

2015-05-20 18:51:59,669 (conf-file-poller-0) [信息- org.apache.flume.node.Application.startAllComponents(Application.java:138)] 开始新配置:{ sourceRunners:{} sinkRunners:{} 频道:{} }

2015-05-20 18:51:59,723 (conf-file-poller-0) [信息- org.apache.flume.node.Application.stopAllComponents(Application.java:101)] 关闭配置:{ sourceRunners:{} sinkRunners:{} 频道:{} }

2015-05-20 18:51:59,724 (conf-file-poller-0) [信息- org.apache.flume.node.Application.startAllComponents(Application.java:138)] 开始新配置:{ sourceRunners:{} sinkRunners:{} 频道:{} }

【问题讨论】:

  • 日志在说什么?您正在打印的输出是标准输出。日志应位于/var/log/cygnus(不过,请查看您在log4j.properties 中配置的内容,以了解日志的确切位置)。您使用的是什么版本的 Cygnus?你的配置是什么?
  • 在主帖中添加了版本、日志和配置文件。

标签: fiware fiware-cygnus


【解决方案1】:

正如您在此日志中看到的:

2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] Invalid property specified: channel

由于channel 属性无效,因此未配置通道。取而代之的是,您必须使用channels:

cygnusagent.channels = mysql-channel

请考虑使用Cygnus template 来创建您的配置(还有一个section in the README 与此相关)。

【讨论】:

  • 这是一个问题,但仍然无法正常工作。我应该在此处发布新日志还是在新问题中发布?
  • 我要说另一个问题。不过,在此之前,请尝试将所有包名称从 es.tid.fiware.fiwareconnectors.* 更改为 com.telefonica.iot.*;从 0.8.0 开始,这些包名称发生了变化 ;)
【解决方案2】:

日志的问题之一是:

2015-05-20 18:51:59,652 (Thread-1) [FATAL - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] 运行管理界面的致命错误。 Details=地址已在使用中

这是由于在运行 cygnus 的一项试验中产生的垃圾进程。通过杀死进程解决。

还进行了其他响应中建议的更改以清除所有警告。

【讨论】:

  • 该问题已在 Cygnus 的最新版本 (> 0.8.0) 中确定并修复。无论如何,它并没有影响 Cygnus,尽管日志的 FATAL 级别:)
猜你喜欢
  • 1970-01-01
  • 1970-01-01
  • 2021-03-09
  • 1970-01-01
  • 1970-01-01
  • 2023-03-27
  • 2018-02-10
  • 1970-01-01
  • 1970-01-01
相关资源
最近更新 更多