

MLOps.community
Demetrios
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)
Episodes
Mentioned books

9 snips
Sep 5, 2024 • 1h 3min
Building in Production Human-centred GenAI Solutions // Mohamed Abusaid & Mara Pometti// #177
In this engaging conversation, Mohamed Abusaid, an advocate for AI governance, and Mara Pometti, a design director at McKinsey, dive into the ethical intricacies of AI technology. They discuss the crucial need for governance programs to navigate safety challenges and risk management. The duo emphasizes transforming organizations from passive AI users to proactive creators, highlighting the balance between open-source models and managed services. Their insights reveal how responsible AI can enhance customer trust while navigating regulatory landscapes.

6 snips
Sep 3, 2024 • 51min
Visualize - Bringing Structure to Unstructured Data // Markus Stoll // #258
Markus Stoll, Co-Founder of Renumics and developer of the interactive ML dataset exploration tool Spotlight, shares fascinating insights on structuring unstructured data like text and images. He discusses advanced techniques such as U-MAP for data visualization, enhancing anomaly detection and user experience. Markus emphasizes the importance of personalized models in industrial AI and the iterative approach for managing complex automotive datasets. His innovative methods bridge the gap between machine learning and practical applications, making data analysis more accessible.

7 snips
Sep 1, 2024 • 10min
AI Testing Highlights // Special MLOps Podcast Episode
Demetrios Brinkmann, Chief Happiness Engineer at MLOps Community, leads a lively discussion with expert guests: Erica Greene from Yahoo News, Matar Haller of ActiveFence, Mohamed Elgendy from Kolena, and freelance data scientist Catherine Nelson. They dive into the intricacies of ML model testing, particularly around hate speech detection. The conversations reveal the unique challenges of AI quality assurance compared to traditional software, the importance of tiered testing, and strategies for balancing swift AI product releases with safety measures.

Aug 30, 2024 • 43min
MLSecOps is Fundamental to Robust AISPM // Sean Morgan // #257
Sean Morgan, Chief Architect at Protect AI and a pivotal figure in the TensorFlow Addons community, shares insights on the crucial role of MLSecOps in AI Security. He discusses the need for proactive security integration in MLOps compared to traditional DevOps, emphasizing vulnerabilities in AI models. Sean highlights the challenges of managing model artifacts, securing open-source AI frameworks, and adopting a zero-trust strategy. He also calls for collaborative efforts within the MLSecOps community to enhance overall machine learning security.

5 snips
Aug 27, 2024 • 1h 7min
MLOps for GenAI Applications // Harcharan Kabbay // #256
Harcharan Kabbay is a data scientist and AI/ML engineer specializing in MLOps, Kubernetes, and DevOps. He delves into the Retrieval-Augmented Generation framework, emphasizing its role in enhancing AI functions. The conversation covers best practices for integrating MLOps with CI/CD pipelines, focusing on automation techniques and security strategies. Harcharan also discusses the significance of collaboration and shared responsibility in organizations and navigates the complexities of data monitoring and observability in machine learning operations.

Aug 23, 2024 • 51min
BigQuery Feature Store // Nicolas Mauti // #255
Nicolas Mauti, an MLOps Engineer from Lyon, shares his expertise in transforming BigQuery into a powerful feature management system for AI/ML applications. He discusses the challenges of feature versioning, monitoring, and data quality that his team overcame at Malt. The conversation explores how separating feature creation from model coding streamlined their workflows and enhanced performance. Nicolas also emphasizes the importance of effective data lineage tracking and retraining models to ensure consistent accuracy across machine learning projects.

17 snips
Aug 20, 2024 • 1h 10min
Design and Development Principles for LLMOps // Andy McMahon // #254
Andy McMahon, a Principal AI Engineer at Barclays Bank, shares his expertise on LLMOps principles, highlighting the essential shift from MLOps to managing large language models. He discusses the complexities of AI and machine learning operations, emphasizing automation and testing challenges. Andy reflects on the evolving tech landscape, stressing the importance of aligning technology with business goals and effective communication of ROI. He also notes the vital role of product managers in optimizing AI interactions to create real value for organizations.

Aug 16, 2024 • 27min
Data Quality = Quality AI // AIQCON Panel
In this discussion, Chad Sanderson, CEO of Gable, Joe Reis, CEO of Ternary Data, and Maria Zhang, CEO of Proactive AI Lab Inc, delve into the crucial link between data quality and AI performance. They highlight real-world challenges organizations face, emphasizing the need for structured data management. The panel discusses pitfalls in AI implementations, the role of metadata, and the importance of holistic ownership and collaboration in enhancing data quality. Listeners gain insights on improving data pipelines with effective strategies and tools.

Aug 13, 2024 • 56min
The Variational Book // Yuri Plotkin // #253
Yuri Plotkin, a Biomedical Engineer and Machine Learning Scientist, dives into his journey from biology to AI, driven by curiosity. He discusses generative AI and diffusion models, tracing their evolution and potential across industries. Highlighting the intricate relationships between various machine learning models, he uses analogies and humor to illustrate concepts. Yuri emphasizes the need for a blend of theory and practice in machine learning engineering, while addressing the complexities of deploying AI in diverse sectors.

6 snips
Aug 9, 2024 • 31min
Vision and Strategies for Attracting & Driving AI Talents in High Growth // Panel // AIQCON
Discover the secrets to attracting and retaining top AI talent in a competitive landscape. Panelists discuss the importance of an intellectually stimulating work environment and team diversity for effective AI solutions. Learn how to navigate organizational alignment for AI development and the critical role of collaboration. Strategies for maintaining focus while fostering creativity within teams are highlighted. Finally, delve into effective leadership approaches that enhance employee satisfaction and support ongoing professional growth.