MLOps vs ML Orchestration // Ketan Umare // #183

40 snips

Oct 20, 2023

Ketan Umare, CEO at Union.ai, discusses ML orchestration vs MLOps, prioritizing features for open-source and enterprise projects, challenges of ML orchestration, building a flexible architecture, Unionverse flight and plugin models, challenges of large language models and evaluation.

Ask episode

Chapters

Transcript

Episode notes

Introduction

00:00 • 4min

Revisiting Orchestration and Startup Challenges

03:59 • 7min

Challenges of ML Orchestration and the User-First Philosophy

11:26 • 14min

Exploring ML Ops Content and Building a Flexible Architecture

25:51 • 2min

Unionverse Flight and Plugin Models

27:31 • 18min

Challenges of Large Language Models and Evaluation

45:30 • 4min

MLOps podcast #183 with Ketan Umare, CEO of Union.AI, MLOps vs ML Orchestration co-hosted by Stephen Batifol. // Abstract Let's explore the relationship between Union and Flyte, emphasizing the significance of community-driven development and the challenge of balancing feature requests with security considerations. This conversation highlights the importance of real-time data and secure data handling in orchestrating machine learning models. The Flyte community's empathy and support for newcomers underscore the community's value in democratizing machine learning, making it more accessible and efficient for a broader audience. // Bio Ketan Umare is the CEO and co-founder at Union.ai. Previously he had multiple Senior roles at Lyft, Oracle, and Amazon ranging from Cloud, Distributed storage, Mapping (map-making), and machine-learning systems. He is passionate about building software that makes engineers' lives easier and provides simplified access to large-scale systems. Besides software, he is a proud father, and husband, and enjoys traveling and outdoor activities. // MLOps Jobs board https://mlops.pallet.xyz/jobs // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links Website: https://union.ai/ Flyte: https://flyte.org/ ⁠ --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Stephen on LinkedIn: https://www.linkedin.com/in/stephen-batifol/ Connect with Ketan on LinkedIn: https://www.linkedin.com/in/ketanumare/ Timestamps: [00:00] Ketan's preferred coffee [01:05] Takeaways [03:08] Please like, share, and subscribe to our MLOps channels! [03:15] Shout out to Ketan and UnionAI for sponsoring this episode! [04:23] Orchestration recent changes [07:51] Community with Flyte [11:26] ML orchestration [15:40] 50/50 is generous [20:06] Real-time ML [21:15] Over engineering without benefits [23:20] Balancing everything [27:40] Union verse Flyte [32:52] High value features of Union AI at the back of Flyte [40:18] Building LLM infrastructure [45:30] Traditional ML is the whole prompting [46:46] LLMs to evaluating prompts [48:55] Wrap up