Developer Voices ByteWax: Rust's Research Meets Python's Practicalities (with Dan Herrera)
May 8, 2024
Dan Herrera, an expert at blending Rust's research with Python's practicalities, talks about Bytewax, a stream processing tool merging Python and Rust. They discuss the marriage of Python and Rust in practice, the challenges in data engineering, integration of Rust into Python ecosystem, timely data flow library design challenges, data flow management with Bytewax and Timely, and cluster recovery and rescaling in PyLax.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8
Introduction
00:00 • 2min
Exploring the Evolution of Real-time Data Streaming
02:12 • 2min
Rust Integration into Python Environment for Data Streaming
03:59 • 4min
Timely Data Flow Library: Design Challenges and Practical Applications
08:08 • 19min
Data Flow Management with Bitewax and Timely
26:54 • 11min
Integrating Rust and Python for Data Processing
37:44 • 15min
Cluster Recovery and Rescaling in PyLax
52:24 • 7min
Reflecting on 50 Episodes and First Podcast Birthday Celebration
59:18 • 2min