Weaviate Podcast Scaling Pandas with Devin Petersohn - Weaviate Podcast #101!
Jul 17, 2024
Devin Petersohn, creator of Modin and co-founder of Ponder, acquired by Snowflake, discusses optimizing pandas data frames, building Moden to match pandas API, query optimization in large language model systems, and handling CSV files efficiently in distributed systems on the Weaviate Podcast.
Chapters
Transcript
Episode notes
1 2 3 4 5 6
Intro
00:00 • 4min
Contrasting Data Frames and SQL Databases
03:32 • 3min
Building Moden: A System Matching the pandas API
06:33 • 9min
Optimizing Queries in Large Language Model Systems and Distributed Systems
15:29 • 7min
Exploring Data Science Workflows and File Formats Innovation
22:08 • 3min
Efficient CSV File Reading and Handling in Distributed Systems
25:22 • 22min