Developer Voices The State & Future of Apache Kafka (with Anatoly Zelenin)
23 snips
May 8, 2025 Anatoly Zelenin, co-author of 'Apache Kafka in Action,' shares his expertise on the evolution of Apache Kafka and its impact on real-time data processing. He discusses Kafka's advantages over traditional databases and the complexities of integrating microservices. The conversation covers the challenges of building scalable data infrastructure, including data silos and transformation limitations. Zelenin highlights Kafka's promising future in enhancing transaction management and its critical role in optimizing modern data architectures.
AI Snips
Chapters
Books
Transcript
Episode notes
Kafka Is Fundamentally A Log
- Kafka is fundamentally just an append-only log that stores a history of events in order.
- This log-centric model is powerful for building IT architectures centered on event history and real-time data flows.
Database Vs Kafka Log Purpose
- Databases describe the current state of the world as we know it, optimized for internal service use.
- Kafka's log answers the question "What happened?" by providing a historical record of events.
Inside Versus Outside Data
- Inside data must be optimized tightly for service efficiency; outside data must be decoupled for communication between teams.
- External data formats need to be contracts that allow independent teams to work without tight coupling.
