JMXtrans 没有为 ganglia 创建 rrd 的 kafka 指标答案

【问题标题】：JMXtrans not creating rrd's of kafka metrics for gangliaJMXtrans 没有为 ganglia 创建 rrd 的 kafka 指标
【发布时间】：2015-09-01 06:56:01
【问题描述】：

我正在尝试使用 jmxtrans 和 ganglia 监控 kafka 代理。但是使用下面的 json，不会创建 rrd。

{
"servers": [
    {
        "port": "9999",
        "host": "localhost",
        "queries": [
            {
                "outputWriters": [
                    {
                        "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                        "settings": {
                            "groupName": "kafka topic stats",
                            "port": 8649,
                            "host": "localhost",
            "typeNames":[
                "name"
            ]
                        }
                    }
                ],
                "obj": "\"kafka.server\":type=\"BrokerTopicMetrics\",name=\"*\"",
                "resultAlias": "Kafka",
                "attr": [
                    "Count",
                    "OneMinuteRate"
                ]
            },
            {
                "outputWriters": [
                    {
                        "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                        "settings": {
                            "groupName": "kafka server request",
                            "port": 8649,
                            "host": "localhost"
                        }
                    }
                ],
                "obj": "\"kafka.network\":type=\"RequestMetrics\",name=\"Produce-RequestsPerSec\"",
                "resultAlias": "produce",
                "attr": [
                    "Count",
                    "OneMinuteRate"
                ]
            }
        ],
        "numQueryThreads": 2
    }
]
}

jmxtrans.log中打印的日志是

[01 Sep 2015 11:53:28] [SIGTERM handler] 4030449 DEBUG (com.googlecode.jmxtrans.JmxTransformer:463) - Stopped writer: GangliaWriter for query: Query [obj="kafka.network":type="RequestMetrics",name="Produce-RequestsPerSec", resultAlias=produce, attr=[Count, OneMinuteRate]] [01 Sep 2015 11:54:33] [main] 0 DEBUG (com.googlecode.jmxtrans.JmxTransformer:223) - Loaded file: /usr/share/jmxtrans/kafka-test.json [01 Sep 2015 11:54:33] [main] 5 DEBUG (com.googlecode.jmxtrans.JmxTransformer:297) - Scheduled job: localhost:9999-1441088673052 for server: Server [host=localhost, port=9999, url=null, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:54:33] [ServerScheduler_Worker-1] 9 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:31) - +++++ Started server job: Server [host=localhost, port=9999, url=null, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:54:33] [ServerScheduler_Worker-1] 38 DEBUG (com.googlecode.jmxtrans.util.JmxUtils:95) - ----- Creating 2 query threads [01 Sep 2015 11:54:33] [ServerScheduler_Worker-1] 43 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:50) - +++++ Finished server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:55:33] [ServerScheduler_Worker-2] 60006 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:31) - +++++ Started server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:55:33] [ServerScheduler_Worker-2] 60008 DEBUG (com.googlecode.jmxtrans.util.JmxUtils:95) - ----- Creating 2 query threads [01 Sep 2015 11:55:33] [ServerScheduler_Worker-2] 60014 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:50) - +++++ Finished server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:56:33] [ServerScheduler_Worker-3] 120006 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:31) - +++++ Started server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:56:33] [ServerScheduler_Worker-3] 120008 DEBUG (com.googlecode.jmxtrans.util.JmxUtils:95) - ----- Creating 2 query threads [01 Sep 2015 11:56:33] [ServerScheduler_Worker-3] 120014 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:50) - +++++ Finished server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:57:33] [ServerScheduler_Worker-4] 180006 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:31) - +++++ Started server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2] [01 Sep 2015 11:57:33] [ServerScheduler_Worker-4] 180009 DEBUG (com.googlecode.jmxtrans.util.JmxUtils:95) - ----- Creating 2 query threads [01 Sep 2015 11:57:33] [ServerScheduler_Worker-4] 180014 DEBUG (com.googlecode.jmxtrans.jobs.ServerJob:50) - +++++ Finished server job: Server [host=localhost, port=9999, url=service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi, cronExpression=null, numQueryThreads=2]

但是，我尝试获取正常的 java 内存信息而不是 kafka 度量，生成了 rrd。请提出我是否犯了任何配置错误或其他问题。

【问题讨论】：

标签： apache-kafka ganglia jmxtrans

【解决方案1】：

从日志文件中可以看出，没有指标发送到 gmond。您在 json 文件中有错误。对于正确的工作替换：

"obj": "kafka.server:type=BrokerTopicMetrics,name=*", 和

"obj": "kafka.network:type=RequestMetrics,name=Produce-RequestsPerSec",重新启动 jmxtrans 守护程序，您应该在 jmxtrans 日志文件中看到与以下内容相同：

[12 Sep 2015 01:25:11] [pool-22-thread-1] 630550 DEBUG (com.googlecode.jmxtrans.util.JmxUtils:195) - Executing queryName: kafka.server:name=BytesInPerSec,type=BrokerTopicMetrics from query: Query [obj=kafka.server:type=BrokerTopicMetrics,name=*, resultAlias=Kafka, attr=[Count, OneMinuteRate]]

【讨论】：