The Data Exchange with Ben Lorica

Jure Leskovec, a Stanford professor and co-founder of Kumo.ai, dives into the transformative power of relational foundation models for structured enterprise data. He challenges the current limitations of AI in handling relational data, emphasizing the shortcomings of treating tabular data as text. Jure outlines Kumo’s rapid predictive SQL-like language, innovative graph representations, and the model's ability to handle messy data effectively. He also discusses real-world successes like DoorDash's significant improvements and the potential applications of these models across various industries.

Philip Rathle, CTO of Neo4j and a leading expert in graph technologies, explores the integration of knowledge graphs in enterprise AI. He discusses the real-world application of GraphRAG, detailing how it enhances context for AI agents. Rathle highlights successful enterprises using this technology and warns against overly complex projects. He also showcases tools like the LLM Graph Builder for building starter knowledge graphs and emphasizes the need for clear governance and determinism in AI systems, ultimately illustrating how graphs can significantly improve AI reasoning.

Emmanuel Ameisen, an interpretability researcher at Anthropic and author, dives into the workings of large language models. He explains how these models can resemble biological systems and reveals surprising problem-solving patterns, like predicting multiple tokens at once. Emmanuel also addresses the misleading nature of reasoning outputs and the neural mechanics behind hallucinations. He emphasizes the importance of model calibration, debugging tools, and even shares practical advice for developers. It's a fascinating look at the complexity of AI behavior!

Evangelos Simoudis, a venture investor and corporate innovation expert at Synapse Partners, joins the discussion to unpack how AI is reshaping the workforce and corporate strategies. He explains the complexities behind AI-driven layoffs, categorizing them into untrainability and automation. They also explore the need for ROI in massive capital investments in AI, while discussing how LLMOps can manage financial efficiencies. Evangelos emphasizes the importance of cross-functional teams for successful AI integration, highlighting the evolving landscape of AI as a utility.

Ciro Greco, Co-founder and CEO of Bauplan, discusses revolutionizing data engineering by applying software principles like version control and transactional pipelines to data lakes. He highlights the unique challenges of data work, such as scale and fragmentation, and introduces a git-like branching model for enhanced reproducibility. Ciro emphasizes the importance of transactional guarantees, especially for automated agents, and advocates for a code-first approach to enable safe and efficient interactions with data platforms.

Mike Freedman and Ajay Kulkarni, co-founders of Tiger Data, discuss their innovative creation, Agentic Postgres, a database tailored for AI agents. They explain how traditional Postgres struggles with search and scalability when used by agents and introduce concepts like Fluid Storage for instant database forks. The conversation covers the importance of developer-friendly features and the unique capabilities of their MCP server, which enhances model training while ensuring security. They also touch on using Postgres for unstructured data and the future of database tooling.

Nick Schrock, CTO and founder of Dagster, explores the transformative power of data orchestration in the age of AI. He introduces Compass, a Slack-native tool designed for collaborative data analysis, aiming to replace inefficient ad-hoc dashboards. Schrock explains the concept of context pipelines, crucial for AI strategies, and highlights how Compass improves user interaction and onboard processes. He also discusses the synergy of automation and human contributions, making data workflows more efficient and integrated in team environments.

In this conversation, Evangelos Simoudis, a venture investor and partner at Synapse Partners with a deep focus on AI and robotics, shares crucial insights into why many enterprise AI pilots stall and the signs of an emerging AI bubble, including runaway valuations. He emphasizes the importance of cross-functional ownership for successful AI adoption and compares the current situation with the past internet boom. They also discuss U.S.-China competition in technology, noting China's advancements in robotics and semiconductors while maintaining a cautionary perspective on humanoid robots.

Luke Wroblewski, venture partner at Sutter Hill Ventures and expert on AI and application design, dives into the shift from traditional coding to an AI-driven approach in application development. He introduces the 'URL + model' paradigm, showcasing how AI agents can now replace conventional databases. Luke discusses the innovative AgentDB, designed specifically for AI agents, and shares examples of practical applications such as personal finance management and lead enrichment. He emphasizes the evolving roles of designers and developers in this new landscape.

Heiko Hotz and Sokratis Kartakis, engineers at Google Cloud, delve into the Agent-to-Agent (A2A) protocol, a groundbreaking standard for AI collaboration across different frameworks. They discuss the importance of statefulness and security in multi-agent systems. With real-world examples, they illustrate how specialized agents communicate similarly to business cards. The duo also highlights the A2A’s potential to transform enterprise communication while addressing security concerns and developer ease of adoption, marking a significant step for future AI interactions.