The Backend Engineering Show with Hussein Nasser cover image

Kafka Consumer Group is a Brilliant Design Choice and We should Discuss it

The Backend Engineering Show with Hussein Nasser

00:00

The Problem With Head of Line Blocking

With pipelining to be specific like price and multiple records on the same TCP connection, those responses should come in the same order. Instead of physically removing that, you can stream partitioning. You can read all the messages. You can keep them forever if you want. You can go back and read them. You can do all kinds of stuff. There's one problem with the consumer group that I actually, I never thought about. And it's called hit of line broking. We had the same problem with HTTP ... It's this whole problem with exactly once guarantee with exactly at least once guaranteeAll these are complex topics, right? So if you think this field is done, no

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app