Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson
Tim Berglund sits down with Colin McCabe and Jason Gustafson to talk about KIP-500. The pair, who work on the Kafka Core Engineering Team, discuss the history of Kafka, the creation of KIP-500, and what it will do for the community as a whole. They break down ZooKeeper's role in Kafka, the implications of removing ZooKeeper dependency, replacing it with a self-managed metadata quorum, and how they've been combatting security, stability, and compatibility issues. With pending improvements towards scalability and inter-broker communication, and now that KIP-500 has been adopted within the community—there's a lot covered in this episode that you won't want to miss!
EPISODE LINKS
- KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
- KIP-497: Add inter-broker API to alter ISR
- ZooKeeper Atomic Broadcast
- The Atomic Broadcast Problem
- RAFT Animated Guide
- RAFT (Computer Science)
- Join the Confluent Community Slack
SEASON 2
Hosted by Tim Berglund, Adi Polak and Viktor Gamov
Produced and Edited by Noelle Gallagher, Peter Furia and Nurie Mohamed
Music by Coastal Kites
Artwork by Phil Vo
- 🎧 Subscribe to Confluent Developer wherever you listen to podcasts.
- ▶️ Subscribe on YouTube, and hit the 🔔 to catch new episodes.
- 👍 If you enjoyed this, please leave us a rating.
- 🎧 Confluent also has a podcast for tech leaders: "Life Is But A Stream" hosted by our friend, Joseph Morais.