【问题标题】:Hbase connectivity with Zookeeper connect and disconnect frequently but code exit with 0与 Zookeeper 的 Hbase 连接频繁连接和断开连接,但代码以 0 退出
【发布时间】:2016-08-22 18:56:29
【问题描述】:

我正在使用 TitanDB 和存储后端 Hbase 由 zookeeper 和索引后端管理:Elasticsearch 我的问题是 hbase 与 zookeeper 连接并立即断开连接,但代码以 0 退出。

==================elasticsearch.yml=====

cluster.name: elasticsearch_graph_dev
script.disable_dynamic: true
node.name: "node_graph_dev"
bootstrap.mlockall: true
network.host: 127.0.0.1

==================hbase-site.xml========

<configuration>
<property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>/zookeeper</value>
</property>
<property>
    <name>zookeeper.znode.parent</name>
    <value>/hbase-unsecure</value>
</property>
<property>
    <name>hbase.manages.zk</name>
    <value>true</value>
</property>
<property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
</property>

</configuration>

==============zoo.cfg========

enter code here

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/tmp/zookeeper
clientPort=2181

==============控制台消息=====

[main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x2a097d77, quorum=localhost:2181, baseZNode=/hbase-unsecure
[main] INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Process identifier=hconnection-0x2a097d77 connecting to ZooKeeper ensemble=localhost:2181
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x154526f4c3e214d, negotiated timeout = 40000
[main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=catalogtracker-on-hconnection-0x2a097d77, quorum=localhost:2181, baseZNode=/hbase-unsecure
[main] INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Process identifier=catalogtracker-on-hconnection-0x2a097d77 connecting to ZooKeeper ensemble=localhost:2181
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
[main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x154526f4c3e214e, negotiated timeout = 40000
[main] INFO org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x154526f4c3e214d
[main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x154526f4c3e214d closed
[main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
[main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x154526f4c3e214e closed
[main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
[main] INFO org.apache.hadoop.hbase.client.HBaseAdmin - Started disable of titan


Titan version = 1.0.0
hbase version = 0.98.12
zookeeper version = 3.4.6
elasticsearch version = 1.5.1

================================================ =======

上面的信息一直打印很多次,我只是想知道它会打印多次还是只打印一次(然后如何解决它)。

我可以看到我在 elasticsearch gui 中创建的索引以及 hbase 终端 + gui 中的表。

谢谢

编辑

HBase 日志:

2016-04-28 14:01:41,884 INFO [pool-14-thread-1] catalog.CatalogTracker: Failed verification of hbase:meta,,1 at address=172.20.56.111,60020,1461827886746, exception=java.net.ConnectException: Connection refused 
2016-04-28 14:01:41,884 INFO [pool-14-thread-1] master.HMaster: Forcing expire of 172.20.56.111,60020,1461827886746 
2016-04-28 14:01:41,885 INFO [pool-14-thread-1] master.ServerManager: Master doesn't enable ServerShutdownHandler during initialization, delay expiring server 172.20.56.111,60020,1461827886746

【问题讨论】:

  • 你能在 hbase 日志或 zookeeper 日志中查看连接关闭的原因吗?
  • 2016-04-28 14:01:41,884 INFO [pool-14-thread-1] 目录。CatalogTracker:地址=172.20.56.111,60020 的 hbase:meta,,1 验证失败, 1461827886746,异常=java.net.ConnectException:连接被拒绝 2016-04-28 14:01:41,884 INFO [pool-14-thread-1] master.HMaster:强制过期 172.20.56.111,60020,1461827886746 2016-04- 28 14:01:41,885 INFO [pool-14-thread-1] master.ServerManager:Master 在初始化期间未启用 ServerShutdownHandler,延迟过期服务器 172.20.56.111,60020,1461827886746
  • 和动物园管理员?没有错误?
  • EndOfStreamException: 无法从客户端 sessionid 0x1545c21bde806f9 读取附加数据,可能客户端已在 org.apache.zookeeper 的 org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) 处关闭套接字.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) at java.lang.Thread.run(Thread.java:745)
  • INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - 接受来自 /127.0.0.1:58721 的套接字连接 INFO [NIOServerCxn.Factory:0.0.0.0/0.0 .0.0:2181:ZooKeeperServer@868] - 客户端尝试在 /127.0.0.1:58721 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] 处建立新会话 - 已接受来自 /0 的套接字连接:0:0:0:0:0:0:1:58722

标签: hbase apache-zookeeper titan


【解决方案1】:

here 所述,这些都只是INFO 消息。这只是噪音。如果它们打扰您,您可以使用 log4j 属性来配置日志记录级别以降低它们。

log4j.logger.org.apache.zookeeper=WARN
log4j.logger.org.apache.hadoop.hbase.client=WARN
log4j.logger.org.apache.hadoop.hbase.zookeeper=WARN

【讨论】:

    猜你喜欢
    • 2012-02-10
    • 1970-01-01
    • 1970-01-01
    • 2011-07-12
    • 1970-01-01
    • 1970-01-01
    • 2012-11-08
    • 1970-01-01
    • 2012-03-02
    相关资源
    最近更新 更多