

MLOps.community
Demetrios
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)
Episodes
Mentioned books

41 snips
Sep 5, 2025 • 53min
LLM Search, UI/UX challenges, Context Engineering and the 80/20 of Eval
Nishikant Dhanuka, Senior Director of AI at Prosus Group, dives into enhancing AI agents for e-commerce and productivity. He shares insights on context engineering, highlighting the importance of user history and real-time data for smarter interactions. The discussion also covers UI/UX challenges, emphasizing better search functionalities through semantic understanding. Nishikant introduces collaborative user evaluations via 'labeling parties' and stresses the need for AI to genuinely simplify lives, not complicate them.

23 snips
Sep 1, 2025 • 49min
The Era of AI Agents in Marketing // Joel Horwitz // #337
Joel Horwitz, a Growth Engineer at Neoteric3D, discusses the transformative role of AI agents in marketing. He highlights how tools like Clay are enabling hyper-personalized campaigns, redefining the role of GTM teams from mere marketers to builders. The conversation delves into modernizing lead qualification, emphasizing the importance of human connections alongside AI. Joel also addresses the game-changing potential of large language models in strategies like SEO and Google AdWords management, showcasing innovative approaches to engage clients.

33 snips
Aug 27, 2025 • 58min
Distilling 200+ Hours of NeurIPS: What’s Next for AI // Nikolaos Vasiloglou // #336
Nikolaos Vasiloglou, VP of Research-ML at RelationalAI, dives into insights from over 200 hours of discussions at NeurIPS. He emphasizes the evolution of AI, particularly in language models and generative AI. Nikolaos discusses challenges in utilizing deep learning for tabular data and the role of knowledge graphs in enhancing AI processes. He also explores how AI could eventually automate research synthesis, making real-time conference summaries a reality. Tune in for a peek into the future of AI research and its practical applications!

68 snips
Aug 22, 2025 • 50min
Building Coding Agents: Design Decisions, Prompting Tricks, GUI Anti-patterns
In this engaging conversation, Beyang Liu, CTO of Sourcegraph, dives into how AI coding agents are transforming software development. He discusses the innovative AMP tool, which enhances code generation and streamlines user interactions. Beyang shares strategies top users employ to maximize agent efficiency, along with prompting techniques that elevate performance. The future of software interfaces is examined, moving from clicks to conversations, emphasizing natural language processing for a seamless user experience. The balancing act of user experience design is also explored, showcasing the complexities and innovations in coding tools.

31 snips
Aug 21, 2025 • 33min
A Candid Conversation with the CEO of Stack Overflow
Prashanth Chandrashekar, CEO of Stack Overflow, discusses the platform’s evolution in the AI era, focusing on its partnerships with tech giants like OpenAI and Google. He emphasizes the importance of data licensing and curated knowledge to maintain developer trust amidst AI advancements. Prashanth explores the complexity of modern Q&A, the rising demand for nuanced programming solutions, and how Stack Overflow is enhancing developer productivity by consolidating information and fostering community collaboration in a rapidly changing landscape.

33 snips
Aug 17, 2025 • 55min
Knowledge is Eventually Consistent // Devin Stein // #335
In this engaging conversation, Devin Stein, the CEO and Founder of Dosu, shares insights from his extensive experience in startups and open source. He discusses the transformative role of AI in knowledge management, focusing on building tools that enhance collaboration and clarity in decision-making. Topics like the challenges of navigating jargon in data analysis and the importance of concise communication in AI interactions are explored. Devin also emphasizes revitalizing documentation practices to serve as a reliable source in fast-paced environments.

28 snips
Aug 12, 2025 • 48min
LinkedIn Recommender System Predictive ML vs LLMs
Arpita Vats, a leading AI researcher specializing in Natural Language Processing and Recommender Systems, dives into the transformative role of LLMs in enhancing recommendation systems. She discusses how these models outpace traditional methods by interpreting user behavior more naturally. The conversation highlights benefits like reduced manual effort alongside challenges such as latency and costs. They explore the evolving landscape of personalized recommendations, including insights into travel recommendations and the nuances of algorithm visibility in social networking.

27 snips
Aug 9, 2025 • 56min
GPU Considerations, Labeling Privacy, Rapid Fine Tuning, and the Role of Private Eval Pipelines to Benchmark New Models
Zulkuf Genc, Director of AI at Prosus Group, and Paul van der Boor, VP of AI at Prosus Group, dive deep into the world of AI agents in production. They discuss the intricacies of GPU management and the importance of tailored evaluation criteria. Privacy concerns are tackled with innovative tagging methods for user data, while the rapid development of specialized models is highlighted as essential amidst the fast-paced evolution of AI technology. Their insights offer invaluable lessons for anyone looking to navigate the challenges of large-scale AI implementations.

70 snips
Aug 5, 2025 • 48min
The Hidden Bottlenecks Slowing Down AI Agents
Paul van der Boor, VP of AI at Prosus Group, and Bruce Martens, an AI Engineer at the same company, dive into the real bottlenecks in AI agent development. They reveal that it's not just about the tools but also the importance of evaluation and feedback. The duo discusses innovative strategies for creating effective evaluation sets and the impact of existing AI tools on productivity. They also examine the complexities of building custom AI solutions and the challenges of navigating cognitive load when reviewing code, highlighting the balance between AI assistance and developer mental strain.

100 snips
Aug 1, 2025 • 1h 21min
9 Commandments for Building AI Agents
In this insightful discussion, Dmitri Jarnikov, Senior Director of Data Science at Prosus Group, and Paul van der Boor, VP AI at Prosus Group, delve into the complexities of building effective AI agents. They explore the importance of memory and the React cycle for continuous improvement. The conversation touches on balancing human involvement with AI decision-making, budgeting for operations, and the need for intuitive interfaces. Their practical approach offers a fresh perspective on navigating the challenges of AI development.