The Data Exchange with Ben Lorica

Jay Alammar, Director and Engineering Fellow at Cohere and co-author of "Hands-on Large Language Models," delves into enterprise AI. He discusses the challenges in understanding large language models and the adoption of GraphRag, emphasizing the gap between vendor enthusiasm and real-world application. Alammar highlights the balance between self-directed and collaborative learning in AI, and the critical role of evaluation processes for effective AI development. He also explores the potential of smaller AI models, showcasing their efficiency in addressing specific tasks.

Evangelos Simoudis, a venture capitalist at Synapse Partners and a corporate innovation blogger, dives deep into AI's complex landscape. He reveals the challenges of AI regulation in the U.S. compared to China's engineering-centric approach. The discussion highlights how China's governance fosters rapid technological advancement. They also explore issues around intellectual property in training data and the need for transparent regulations. Simoudis emphasizes the importance of balancing innovation with ethical considerations amid a rapidly evolving AI industry.

Anant Bhardwaj, CEO of Instabase, shares insights on creating effective enterprise AI solutions. He underscores the importance of predictability over accuracy, arguing that user confidence hinges on reliable outcomes. The conversation compares AI agents to robotic process automation, highlighting the need for human oversight in complex workflows. Bhardwaj advocates for Retrieval-Augmented Generation to enhance AI systems and discusses the barriers to AI adoption in enterprises, stressing hands-on engagement and tailored strategies for success.

David Talby, an expert in AI governance at John Snow Labs and Pacific AI, shares insights from the 2025 AI Governance Survey involving over 350 industry professionals. He reveals that despite 30% of organizations having AI models in production, there are alarming gaps in risk management practices. The discussion spans AI adoption trends, emphasizing the dual roles of developers and deployers. Talby also stresses the importance of formal policies and unified platforms for effective governance and collaboration in navigating the evolving regulatory landscape.

Kostas Paralis, co-founder of Typedef, introduces Fenic, an innovative open-source framework for AI-driven data processing. He unpacks how Fenic treats inference as a key operation, transforming unstructured data management, and optimizing data pipelines. The conversation dives into the evolution of data technologies, the challenges of integrating structured and unstructured data, and the revolutionary potential of large language models. Kostas also discusses the importance of open file formats and practical use cases in cybersecurity and healthcare, enhancing operational efficiency.

Evangelos Simoudis from Synapse Partners shares insights on critical trends in the AI industry. He discusses the 'Great Hollowing Out,' where automation is wiping out entry-level jobs, making it harder for fresh graduates. The conversation dives into the economic implications of AI hardware depreciation and changing team dynamics that blend experienced and novice talent. Simoudis also explores the evolution of AI business models, particularly in light of GPT-5, reshaping how companies engage with AI services.

Raiza Martin, co-founder of Huxe and former leader of Google's NotebookLM team, shares insights on her exciting transition from a tech giant to startup life. She discusses the innovative potential of audio-first personal AI companions, highlighting how they can enhance daily interactions. The conversation dives into the evolution of AI models and the emotional connections users form with chatbots. Raiza also addresses the challenges of deploying AI and the importance of privacy, showcasing a future where technology feels increasingly personal.

In this engaging discussion, Akshay Agrawal, founder and CEO of Marimo and former TensorFlow engineer, dives into the revolutionary features of Marimo, an open-source reactive notebook aimed at enhancing Python coding. He explores how AI integration provides runtime context for improved code generation, facilitating diverse applications from cybersecurity to DevOps. Akshay also highlights the unique capabilities of Marimo compared to traditional notebooks and the importance of live coding in data analysis, all while addressing the evolving landscape of user needs in data platforms.

Josh Pantony, CEO of Boosted AI, discusses the groundbreaking possibilities of agentic AI in finance. He highlights Alpha, a platform that turns AI into proactive workers for finance professionals, significantly enhancing productivity. The conversation delves into the challenges of maintaining auditability and the importance of balancing speed with quality in AI responses. Pantony also emphasizes the shift toward multimedia consumption of financial information among younger generations, showcasing how AI can revolutionize data analysis and market insights.

Jennifer Prendki, a former DeepMind expert in AI and quantum computing, shares insights on the current landscape of quantum technology. She highlights the rise of specialized quantum accelerators designed for AI in sectors like finance and pharma. The main challenge isn’t just hardware, but the need for innovative software solutions due to fundamental principles like the no-cloning theorem. Prendki emphasizes the importance of integrating quantum data with classical systems and discusses how quantum computing could revolutionize machine learning and data analysis.