MLOps.community

Luke Marsden, CEO of HelixML and a seasoned tech leader, dives into the world of open-source AI models. He discusses how anyone can become an AI engineer, emphasizing the practicality of building Generative AI applications. Luke elaborates on the advantages of open-source solutions for data privacy and business value. He also highlights the importance of structured specifications and customization in AI systems, making advanced features accessible for both technical and non-technical users. Join him for insights into the future of AI innovation!

Jazmia Henry, Founder and CEO of Iso AI, joins a panel of AI experts to explore the future of AI agents. They discuss the integration of voice and visual interfaces, emphasizing how smaller language models can enhance usability. The panel highlights AI's transformative impact across industries like insurance and manufacturing, and the efficiency of deconstructing tasks for better performance. Challenges in scaling AI agents and the importance of quality data are also examined, paving the way for innovative solutions in the rapidly evolving AI landscape.

In this engaging conversation, Lauren Kaplan, a sociologist with a PhD from Goethe University Frankfurt and former UX researcher at Meta, shares her insights into the pivotal role of UX research in shaping AI initiatives. She delves into the challenges of bias in research, emphasizing the importance of unbiased data collection. Kaplan discusses collaborative strategies between UX researchers and ML engineers to enhance user-centric AI tools. Highlighting the necessity for effective communication and alignment within organizations, she champions structured research to drive innovation and user satisfaction.

Petar Tsankov, Co-founder and CEO of LatticeFlow AI, dives into the complexities of the EU AI Act and its impact on AI innovation. He discusses the importance of translating legislation into practical technical requirements. Petar introduces 'Comply,' an open-source tool for AI compliance, while emphasizing the need for robust benchmarks in AI safety. He also sheds light on managing AI risks and the collaboration required among stakeholders to navigate evolving regulations, making it essential listening for AI developers and businesses alike.

Bernie Wu, VP of Strategic Partnerships at MemVerge, brings over 25 years of experience in data infrastructure. He discusses the critical role of innovative memory solutions in optimizing Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) workflows. The conversation covers the advantages of composable memory in alleviating performance limits, efficient resource scheduling, and overcoming GPU challenges. Bernie also touches on the importance of collaboration tools for better memory management and advances in GPU networking technologies that are shaping the future of AI.

Gideon Mendels, CEO and co-founder of Comet, dives into the intricate world of testing and evaluating LLMs. He discusses the hybrid approach required for these applications, merging machine learning with software engineering best practices. Topics include innovative methods for evaluating LLMs beyond traditional metrics, the challenge of unit testing with deterministic assertions, and the importance of experiment tracking in ensuring reproducibility. Gideon also highlights the role of user interaction analysis in enhancing LLM applications' performance.

In this engaging discussion, Raj Rikhy, a Senior Product Manager at Microsoft AI + R, shares insights on deploying AI agents effectively. He highlights the importance of starting small with clear success criteria while maintaining human oversight to manage AI unpredictability. Raj dives into real-time applications like fraud detection and supply chain optimization, emphasizing the efficiency gains from agentic workflows. He also compares this transformative technology to innovations like the iPhone, encouraging listeners to embrace the future of AI.

Join Benjamin Rogojan, a seasoned data engineering consultant, along with Gable's Chad Sanderson, NAO's CTO Christophe Blefari, and Acryl Data's Maggie Hays for a lively discussion on the ever-evolving world of data. They delve into their diverse career journeys and transformative experiences in data engineering. Expect insights on the rise of modern data tools, personal anecdotes about creating data lakes, and the emerging challenges in data governance. Discover how shared ownership of data models enhances collaboration and drives business value!

Jelmer Borst, analytics and machine learning leader at Picnic, and Daniela Solis Morales, machine learning lead, delve into the dynamics of building effective ML teams. They discuss shifting from decentralized to centralized structures and the challenges of recruiting the right talent. The pair explores the complexities of demand forecasting in online grocery delivery and stresses the importance of collaboration between data scientists and business teams. They also highlight the need for lightweight, scalable ML infrastructure and the evolving roles within data science to meet business goals.

In this discussion, Francisco Ingham, an LLM consultant and founder of Pampa Labs, delves into what it means to be LLM-native for companies. He emphasizes the integration of large language models into business functions, balancing productivity with a human touch. The conversation also highlights the importance of tracking optimization in engineering experiments and strategic integration of LLMs within system architecture. Additionally, Ingham explores the complexities of retrieval-augmented generation techniques and their application in enhancing user experiences.