Fork Around And Find Out Getting to Know Kafka with Elad Eldor
6 snips
Mar 7, 2025 Elad Eldor, author of 'Kafka Troubleshooting in Production' and a Data Ops Engineer at Unity, shares his wealth of knowledge about Kafka. He discusses the differences between running Kafka on-prem and in the cloud, unveiling the complexities of cluster management and performance tuning. Elad emphasizes the importance of understanding system bottlenecks and resource optimization to avoid excessive costs. He also touches on the challenges of manual monitoring and the interplay between human expertise and technology in today’s operational landscape.
AI Snips
Chapters
Books
Transcript
Episode notes
Elad's Kafka Journey
- Elad Eldor's journey with Kafka began unexpectedly when he had to troubleshoot Kafka issues as a backend developer.
- He learned Linux and system performance along the way, becoming an SRE.
On-Premises vs. Cloud
- On-premises Kafka allows full access to logs and hardware customization but presents unique challenges like hardware failures.
- Cloud environments offer more support but less control.
Mixing Hardware
- On-premises deployments sometimes require mixing different disk and DIMM sizes due to customer constraints and cost considerations.
- Elad learned to combine different hardware types to meet these demands.
