Kafka java consumer freezes after balance failure

we ran into an annoying Kafka consumer issue after failing to rebalance consumers. It seems we had network problems at the given time, which caused the ZK to expire. This caused a re-registration of consumers and then a rebalancing.
After 4 attempts, the rebalance failed (rebalance.retries.max = 4). On client sides (Java Kafka Consumers), we have not received pb notifications. We just didn't have any new message and clients worked for hours without reading any messages.

Is there a way to get consumers notified of these unsuccessful rebalances so that we can monitor and possibly restart our consumers?

+3
java apache-zookeeper apache-kafka


source to share


No one has answered this question yet

See similar questions:

8
Kafka's only consumer failure in the group

or similar:

nine
Consumer of Kafka, very long rebalances
7
time-out
6
Kafka is unexpectedly rebalanced
3
Consumer does not receive message in Apache Kafka
3
Clear Kafka consumer group with stuck members
2
Email notification when Kafka producer and consumer
1
Kafka consumer does not consume messages after restart
1
Kafka consumer stops consuming messages
0
Does Kafka have any configuration that limits the number of Kafka Consumer messages?
0
High-level consumer rejection in Kafka



All Articles
Loading...
X
Show
Funny
Dev
Pics