AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Weaviate Podcast
Scaling Pandas with Devin Petersohn - Weaviate Podcast #101!
Jul 17, 2024
Devin Petersohn, creator of Modin and co-founder of Ponder, acquired by Snowflake, discusses optimizing pandas data frames, building Moden to match pandas API, query optimization in large language model systems, and handling CSV files efficiently in distributed systems on the Weaviate Podcast.
47:49
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Devin Petersohn's transition from genomics to data scaling highlighted differing priorities between scientists and software engineers.
- Modin, a system created by Devin, simplifies data processing for scientists by abstracting complexities and enhancing productivity.
Deep dives
Devin's Journey From Genomics to Solving Data Scaling Problems
Devin Peterson's career transition from genomics research at UC Berkeley to tackling data scaling problems stemmed from his interest in big data genomics. His work revealed the difference in priorities between scientists and software engineers, emphasizing scientists' focus on productivity and methodologies over speed. Recognizing the similarities between data frames and the needs of data scientists, Devin embarked on solving broader challenges in data analytics and science.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode