
MLOps.community
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)
Latest episodes

99 snips
Feb 20, 2025 • 1h 9min
The Agent Landscape - Lessons Learned Putting Agents Into Production
Paul van der Boor, VP of AI at Prosus Group, and Floris Fok, AI Engineer at the same group, dive into the evolving landscape of AI agents. They discuss the transition from basic models to interactive systems, exploring integration challenges akin to building a Mars Rover. The duo shares insights on generative AI risks and security innovations, the unique roles of AI engineers, and the critical balance between advanced capabilities and user-friendliness. With lessons from over 20 projects, their conversation is packed with practical takeaways for anyone in AI.

30 snips
Feb 14, 2025 • 1h 15min
Evolving Workflow Orchestration // Alex Milowski // #291
Alex Milowski, a serial entrepreneur and computer scientist with a PhD in Informatics, dives into the evolving landscape of workflow orchestration. He discusses the shift from traditional workflow languages to code, emphasizing its implications for complexity in orchestration. Milowski also highlights the importance of visual tools for process modeling and the unique challenges that regulated industries face in machine learning. He contrasts modern technologies with traditional automation, stressing human oversight in AI workflows and the delicate balance of documentation in agile systems.

Feb 11, 2025 • 56min
Insights from Cleric: Building an Autonomous AI SRE // Willem Pienaar // #290
Willem Pienaar, Co-Founder and CTO of Cleric, is on a mission to revolutionize Site Reliability Engineering with autonomous AI solutions. He shares insights into building knowledge graphs for efficient root cause analysis and discusses the intricate challenges of implementing AI in production environments. Willem emphasizes the need for clear communication and strategies to foster trust among engineering teams hesitant to change. Dive into the fascinating intersection of AI and human collaboration in troubleshooting tech issues and enhancing operational resilience!

Feb 7, 2025 • 53min
Robustness, Detectability, and Data Privacy in AI // Vinu Sankar Sadasivan // #289
Vinu Sankar Sadasivan, a PhD candidate at the University of Maryland and Student Researcher at Google DeepMind, dives into the crucial themes of AI robustness and security. He discusses the challenges of jailbreaking multimodal models and explores innovative watermarking techniques for identifying AI-generated content. Vinu highlights the complexities of red teaming practices and automated vulnerability exploitation, showcasing the ongoing battle between AI manipulators and defenders. This engaging session sheds light on the future of safe AI applications across various fields.

Feb 4, 2025 • 48min
AI & Aliens: New Eyes on Ancient Questions // Richard Cloete // #288
Richard Cloete, a computer scientist at Harvard and founder of SEAQR Robotics, joins the discussion on the cutting-edge intersection of AI with UAP tracking. He shares insights from the Galileo Project, detailing the advanced sensor setups and challenges in training AI for sky surveillance. The conversation also highlights Aerosynth, a tool for simulating aerial objects to enhance detection, and Seeker Robotics' innovations in ocean exploration. Cloete emphasizes the importance of AI in classifying interstellar objects and advancing our understanding of both space and oceanic mysteries.

26 snips
Jan 31, 2025 • 50min
Real LLM Success Stories: How They Actually Work // Alex Strick van Linschoten // #287
Alex Strick van Linschoten, a Machine Learning Engineer at ZenML with a PhD in History, delves into practical applications of large language models (LLMs). He shares insights from his comprehensive database on LLM use cases, emphasizing both common and innovative applications. The discussion covers the technical challenges of deploying LLMs, the significance of engineering practices, and the evolution of support bots using user behavior insights. Alex also calls for community contributions to enhance collective knowledge in this rapidly changing field.

31 snips
Jan 27, 2025 • 1h 1min
Navigating Machine Learning Careers: Insights from Meta to Consulting // Ilya Reznik // #286
Ilya Reznik, an ML Engineering Thought Leader with 13 years at Meta, Adobe, and Twitter, shares his journey and insights on navigating machine learning careers. He discusses the limitations of traditional model fine-tuning and promotes innovative methods like prompt engineering. Ilya emphasizes the significance of practical applications from recent conferences and offers guidance for aspiring ML engineers aiming for senior roles. His rich experience blends technical expertise with practical career advice, making it a gem for those in the AI field.

Jan 24, 2025 • 53min
Collective Memory for AI on Decentralized Knowledge Graph // Tomaž Levak // #285
Tomaž Levak, Co-founder and CEO of Trace Labs, dives into the world of decentralized knowledge graphs and their role in AI. He discusses how these graphs enhance data integrity and privacy while promoting collaboration among organizations. Practical use cases in enterprise sectors are highlighted, showcasing their economic potential. Levak also explores the fusion of AI and personal health management, emphasizing innovative technologies that improve well-being. The conversation concludes with insights on the future of decentralized AI and its convergence with blockchain.

8 snips
Jan 17, 2025 • 52min
Efficient Deployment of Models at the Edge // Krishna Sridhar // #284
In this engaging discussion, Krishna Sridhar, an engineering leader at Qualcomm and former co-founder of Tetra AI, dives into the efficient deployment of AI models at the edge. He shares insights on using Qualcomm AI Hub to optimize models for on-device performance, highlighting its application in real-time sports tracking and mobile photography. Krishna also explores the balance between hardware and software optimization in modern devices. Plus, he reveals how innovations in edge computing are transforming everyday AI applications while ensuring user privacy.

46 snips
Jan 15, 2025 • 47min
Real World AI Agent Stories // Zach Wallace // #283
Zach Wallace, a Staff Software Engineer at Nearpod Inc., shares his expertise in AI integration within e-commerce and edtech. He discusses how AI agents enhance personalized user targeting and streamline data with tools like Redshift and DBT. The conversation delves into the challenges of maintaining AI systems, ensuring data quality, and the balance between specialization and cost in agent performance. Zach emphasizes the transformative potential of LLMs in education and the importance of educator involvement for effective AI tool development.