Tech on the Rocks Stream processing, LSMs and leaky abstractions with Chris Riccomini
Aug 23, 2024
Chris Riccomini, an expert in stream processing and LSMs, dives into the evolution of streaming systems, highlighting the challenges developers face. He critiques SQL's limitations in this space and emphasizes the need for better API designs. The discussion also touches on the impact of Rust on usability and efficiency, particularly in embedded libraries. Chris shares insights about his exciting project involving log-structured merge trees on object storage, and the future of data systems with a focus on composable databases and the importance of metadata in AI.
Chapters
Transcript
Episode notes
1 2 3 4 5 6
Intro
00:00 • 4min
The Evolution of Stream Processing Systems
03:53 • 20min
Navigating Usability Challenges in Streaming and Durable Execution
23:35 • 3min
The Future of Software Development in the Age of AI
26:55 • 9min
Innovating with LSM Trees in Object Storage
35:44 • 11min
The Evolution of Database Systems
46:41 • 6min