Kubernetes Podcast from Google Spotify AI Platform, with Avin Regmi and David Xia
10 snips
Sep 24, 2024 Avin Regmi and David Xia from Spotify share exciting insights about building the Hendrix Machine Learning Platform. They discuss the shift from independent ML solutions to a unified approach, leveraging technologies like Kubernetes and Ray. The duo dives into user onboarding challenges and the evolving landscape of ML practices. Furthermore, they emphasize optimizing resource allocation for high-demand components, ensuring fairness in a multi-tenant environment, and striking a balance between speed and reliability in ML deployments.
AI Snips
Chapters
Transcript
Episode notes
ML Platform Definition
- ML platform definitions vary depending on the organization and their ML maturity.
- Smaller organizations have different needs compared to larger enterprises with diverse use cases.
Early ML at Spotify
- Spotify's ML platform evolved from individual teams like Discover Weekly creating their own solutions.
- A centralized platform team emerged to build common infrastructure, improving productivity.
Onboarding New Teams
- New teams at Spotify get a namespace and use Hendrix SDK to define resources.
- They can use notebooks for exploration or Flight for production pipelines.