MLOps.community

Paul van der Boor, VP AI at Prosus Group, and Donné Stevenson, Machine Learning Engineer, dive into the fascinating world of the Token Data Analyst agent. They discuss the agent’s seamless integration into production, overcoming challenges like LLM overconfidence and query accuracy. The duo explores the importance of modular architecture for enhanced interaction and the hurdles of SQL queries amidst unclear definitions. Their insights into structured reasoning models promise a brighter future for data analysis, making complex tasks more efficient and accurate.

Paul van der Boor, VP AI at Prosus Group, and Chiara Caratelli, Data Scientist at Prosus Group, dive into the world of web agents—AI that interacts with the web like humans. They discuss why these agents are crucial in the evolution of AI, especially in improving e-commerce and automation. Challenges in creating agent-friendly web design are tackled, alongside visions of a future where booking flights or ordering food becomes seamless. Their insights into balancing prototyping with scalability offer a glimpse into the future of digital interaction.

Paul van der Boor, VP of AI at Prosus Group, shares his extensive knowledge of voice AI applications, while Floris Fok, an AI Engineer at the same company, delves into the technical hurdles faced with OpenAI’s real-time voice API. They discuss real-time voice interactions in environments like Brazil's food delivery system and explore innovative applications in healthcare, enhancing triaging accuracy. The duo highlights challenges such as language processing and turn detection, emphasizing ongoing improvements and the future of voice technology.

Paul van der Boor, VP of AI at Prosus Group, and Floris Fok, AI Engineer at the same group, dive into the evolving landscape of AI agents. They discuss the transition from basic models to interactive systems, exploring integration challenges akin to building a Mars Rover. The duo shares insights on generative AI risks and security innovations, the unique roles of AI engineers, and the critical balance between advanced capabilities and user-friendliness. With lessons from over 20 projects, their conversation is packed with practical takeaways for anyone in AI.

Alex Milowski, a serial entrepreneur and computer scientist with a PhD in Informatics, dives into the evolving landscape of workflow orchestration. He discusses the shift from traditional workflow languages to code, emphasizing its implications for complexity in orchestration. Milowski also highlights the importance of visual tools for process modeling and the unique challenges that regulated industries face in machine learning. He contrasts modern technologies with traditional automation, stressing human oversight in AI workflows and the delicate balance of documentation in agile systems.

Willem Pienaar, Co-Founder and CTO of Cleric, is on a mission to revolutionize Site Reliability Engineering with autonomous AI solutions. He shares insights into building knowledge graphs for efficient root cause analysis and discusses the intricate challenges of implementing AI in production environments. Willem emphasizes the need for clear communication and strategies to foster trust among engineering teams hesitant to change. Dive into the fascinating intersection of AI and human collaboration in troubleshooting tech issues and enhancing operational resilience!

Vinu Sankar Sadasivan, a PhD candidate at the University of Maryland and Student Researcher at Google DeepMind, dives into the crucial themes of AI robustness and security. He discusses the challenges of jailbreaking multimodal models and explores innovative watermarking techniques for identifying AI-generated content. Vinu highlights the complexities of red teaming practices and automated vulnerability exploitation, showcasing the ongoing battle between AI manipulators and defenders. This engaging session sheds light on the future of safe AI applications across various fields.

Richard Cloete, a computer scientist at Harvard and founder of SEAQR Robotics, joins the discussion on the cutting-edge intersection of AI with UAP tracking. He shares insights from the Galileo Project, detailing the advanced sensor setups and challenges in training AI for sky surveillance. The conversation also highlights Aerosynth, a tool for simulating aerial objects to enhance detection, and Seeker Robotics' innovations in ocean exploration. Cloete emphasizes the importance of AI in classifying interstellar objects and advancing our understanding of both space and oceanic mysteries.

Alex Strick van Linschoten, a Machine Learning Engineer at ZenML with a PhD in History, delves into practical applications of large language models (LLMs). He shares insights from his comprehensive database on LLM use cases, emphasizing both common and innovative applications. The discussion covers the technical challenges of deploying LLMs, the significance of engineering practices, and the evolution of support bots using user behavior insights. Alex also calls for community contributions to enhance collective knowledge in this rapidly changing field.

Ilya Reznik, an ML Engineering Thought Leader with 13 years at Meta, Adobe, and Twitter, shares his journey and insights on navigating machine learning careers. He discusses the limitations of traditional model fine-tuning and promotes innovative methods like prompt engineering. Ilya emphasizes the significance of practical applications from recent conferences and offers guidance for aspiring ML engineers aiming for senior roles. His rich experience blends technical expertise with practical career advice, making it a gem for those in the AI field.