
Kafka Consumer Group is a Brilliant Design Choice and We should Discuss it
The Backend Engineering Show with Hussein Nasser
00:00
The Test v I T a S S Is E Right?
Each partition must belong to one and only one consumer. The partition cannot be read by two consumers in the same group, right? So now you have one consumer in the group. If you add another one, then they start balancing the group. By default, this consumer will be responsible for all partitions by default. We try not to do that stuff. We should not be aware of shards. That's why the tests came in and solved our problem for us and the back-end.
Transcript
Play full episode