The Truth About ZooKeeper Removal and the KIP-500 Release in Apache Kafka ft. Jason Gustafson and Colin McCabe
Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
00:00
The Performance Implications of a Standby Controller
With the new controller, you don't have that anymore because the changes are being applied incrementally. So all the nodes in the cluster can basically build up the state incrementally. With the old controller, with the zookeeper based one, it's just totally infeasible to run a cluster with that many partitions and failover times of 20 minutes or more. You know, we've done some preliminary testing. I think we've gone up as many as, you know, a couple million partitions.
Play episode from 23:59
Transcript
