Evolution of Uber's Michelangelo Platform and Challenges in AI Maintenance

Uber's Michelangelo: Strategic AI Overhaul and Impact // MLOps podcast #239 with Demetrios Brinkmann. Huge thank you to Weights & Biases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops // Abstract Uber's Michelangelo platform has evolved significantly through three major phases, enhancing its capabilities from basic ML predictions to sophisticated uses in deep learning and generative AI. Initially, Michelangelo 1.0 faced several challenges such as a lack of deep learning support and inadequate project tiering. To address these issues, Michelangelo 2.0 and subsequently 3.0 introduced improvements like support for Pytorch, enhanced model training, and integration of new technologies like Nvidia’s Triton and Kubernetes. The platform now includes advanced features such as a Genai gateway, robust compliance guardrails, and a system for monitoring model performance to streamline and secure AI operations at Uber. // Bio At the moment Demetrios is immersing himself in Machine Learning by interviewing experts from around the world in the weekly MLOps.community meetups. Demetrios constantly learns and engages in new activities to get uncomfortable and learn from his mistakes. He tries to bring creativity into every aspect of his life, whether analyzing the best paths forward, overcoming obstacles, or building Lego houses with his daughter. // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links From Predictive to Generative – How Michelangelo Accelerates Uber’s AI Journey blog post: https://www.uber.com/en-JP/blog/from-predictive-to-generative-ai/

Uber's Michelangelo: https://www.uber.com/en-JP/blog/michelangelo-machine-learning-platform/ The Future of Feature Stores and Platforms // Mike Del Balso & Josh Wills // MLOps Podcast # 186: https://youtu.be/p5F7v-w4EN0

Machine Learning Education at Uber // Melissa Barr & Michael Mui // MLOps Podcast #156: https://youtu.be/N6EbBUFVfO8 --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Timestamps: [00:00] Uber's Michelangelo platform evolution analyzed in podcast [03:51 - 4:50] Weights & Biases Ad [05:57] Uber creates Michelangelo to streamline machine learning [07:44] Michelangelo platform's tech and flexible system [11:49] Uber Michelangelo platform adapted for deep learning [16:48] Uber invests in ML training for employees [19:08] Explanation of blog content, ML quality metrics [22:38] Michelangelo 2.0 prioritizes serving latency and Kubernetes [26:30] GenAI gateway manages model routing and costs [31:35] ML platform evolution, legacy systems, and maintenance [33:22] Team debates maintaining outdated tools or moving on [34:41] Please like, share, leave feedback, and subscribe to our MLOps channels! [34:57] Wrap up