20min chapter

Tech on the Rocks cover image

Stream processing, LSMs and leaky abstractions with Chris Riccomini

Tech on the Rocks

CHAPTER

The Evolution of Stream Processing Systems

This chapter explores the evolution and current challenges of stream processing systems, focusing on technologies like Kafka and Flink. It emphasizes the importance of developer productivity in real-time data environments and critiques the limitations of SQL as a framework for stream processing. The discussion highlights the need for better-designed APIs and the ongoing transition in analytics roles, particularly towards analytics engineers, in response to the complexities of modern data engineering.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode