Partition Rebalancer
This lesson explains the process of partition rebalance, which occurs when a consumer leaves the consumer group or new partitions are added.
We'll cover the following...
Membership of consumers in a consumer group is coordinated by a designated Kafka broker referred to as the group coordinator. It receives heartbeats from consumers to confirm that they are alive and healthy. When the group coordinator doesn’t hear from a consumer for a configurable period of time, it assumes the particular consumer has crashed and triggers a partition rebalance. The latest version of Kafka has a dedicated heartbeat thread that sends heartbeats to the group coordinator periodically. ...