kakfa Consumer can't rebalance after 5 retries

JavaAPI中Kafka的消费者不能正确的连接到服务器的Kafka的队列。百度、google了很多都无法解决。

这是配置信息:

        props.put("zookeeper.connect", "XXXXXX:2181");
        //配置Zookeeper连接超时间隔
        props.put("zookeeper.connection.timeout.ms", "1000000");
        //配置Zookeeper的组id(The ‘group.id’ string defines the Consumer Group this process is consuming on behalf of.)
        props.put("group.id", "test-group");

        props.put("zookeeper.session.timeout.ms", "4000");
        props.put("zookeeper.sync.time.ms", "10000");
        props.put("auto.commit.interval.ms", "1000");

        props.put("rebalance.max.retries", "5");
        props.put("rebalance.backoff.ms", "1200");

这是错误日志:

Exception in thread "Thread-0" kafka.common.ConsumerRebalanceFailedException: test-group_yanyongdeMacBook-Pro.local-1471403173076-d34ac5a3 can't rebalance after 5 retries
    at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:660)
    at kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:967)
    at kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnector.scala:254)
    at kafka.javaapi.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:84)
    at kafka.javaapi.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:96)
    at com.yany.consumer.ConsumerTest$MyConsumer.run(ConsumerTest.java:44)
阅读 5.1k
2 个回答

初步认定为kafka版本和服务器端安装Zookeeper版本不兼容导致。我本地使用的kafka是0.9.0.0的版本,换成0.9.0.1的版本就可以用了

ping talent 分别测试一下看通不通,配置没问题

撰写回答
你尚未登录,登录后可以
  • 和开发者交流问题的细节
  • 关注并接收问题和回答的更新提醒
  • 参与内容的编辑和改进,让解决方法与时俱进
推荐问题