
Data Science at Home Polars: the fastest dataframe crate in Rust - with Ritchie Vink (Ep. 146)
Apr 8, 2021
Ritchie Vink, author of Polars, the fastest dataframe library in Rust, discusses his background in data science and how he started working on Polars. They also explore the challenges of designing a new data manipulation library, the significance of thread safety and parallelism in Rust, the use of Apache Arrow as a backhand for communication, and the importance of SIMD instructions in optimizing operations.
Chapters
Transcript
Episode notes
1 2 3 4 5 6
Introduction
00:00 • 2min
Lockdown Effects and Challenges of Designing a Data Manipulation Library
02:25 • 2min
The Importance of Thread Safety and Parallelism in Rust
04:31 • 2min
The Borrow Checker, Apache Arrow, and Polar's Dependency
06:17 • 15min
Optimization of SIMD Instructions
21:30 • 10min
Contributing to Polars and Finding Richie Online
31:12 • 2min
