MLOps.community MLOps Coffee Sessions #12: Journey of Flyte at Lyft and Through Open-source // Ketan Umare
Oct 10, 2020
Ketan Umare, a Senior Staff Software Engineer at Lyft, discusses his pivotal role in the development of Flyte, a pivotal open-source project for machine learning infrastructure. He explains why Flyte was created, highlighting its capacity to handle tens of thousands of workflows and millions of tasks. The conversation delves into the complexities of mapping technology and the algorithmic challenges in ride-sharing. Ketan also shares insights on open-source community engagement and the transition to using Go for backend development.
AI Snips
Chapters
Transcript
Episode notes
Ketan Umare's Career Journey
- Ketan Umare shared his journey from banking anti-money laundering to mapping and logistics at Amazon and later Lyft.
- His varied experience led him to lead machine learning platform infrastructure at Lyft despite originally lacking ML background.
Lyft's Real-Time Marketplace Challenges
- Lyft's marketplace moves in real-time with cars and demand constantly shifting, unlike traditional marketplaces.
- This dynamic creates diverse and complex machine learning and data challenges unlike many tech companies.
Microservices For Team Scalability
- Use microservices to scale engineering teams by team ownership of services and clear interface contracts.
- Invest in contract evolution practices to avoid breaking changes and make onboarding easier.