Jeff Huber

Jeff Huber, Founder and CEO of Chroma, shares insights on the future of vector databases and the unique aspects of modern AI search. He discusses the challenges of context rot and the importance of context quality in AI applications. The conversation dives into retrieval strategies, memory management, and the evolution of transformer architecture. Huber also reflects on his previous startup experiences and the intersection of personal values with company culture, emphasizing the need for a cohesive brand identity in tech.

Jeff Huber, CEO of Chroma, reveals the challenges of 'context rot,' where AI memory decays, impacting performance. He discusses why traditional benchmarks can mislead developers and explains how Chroma's two-stage retrieval optimizes both recall and precision. The conversation dives into the evolution of search technologies, pitfalls of single embeddings, and the intricacies of personalization in semantic search. Huber emphasizes the need for cleaner, engineered solutions in AI that reduce dependency on fragile systems.

Join Jeff Huber, co-founder of Chroma, and Jai Malik, CEO of AMCA, as they dive into Meta's groundbreaking Llama 4 and its implications for open-source AI. Samuel Hammond shares vital insights on tech policy, while Sheel Mohnot discusses fintech market dynamics. Leif Abraham analyzes investor behavior amid turbulence, and Víctor Perez reveals how AI is revolutionizing creativity. The conversation flows through navigating economic challenges, the role of automation in manufacturing, and the interplay of innovation in finance and technology.

Jeff Huber, CEO and co-founder of Chroma, dives into the fascinating world of agentic search, transforming how we approach AI and information retrieval. He discusses the importance of 'context engineering' for reliable AI systems and how context rot complicates this. Huber explains the concept of the 'agent harness' for advanced tools and the necessity of hybrid search to maintain balance. With insights on best practices for builders and the challenges in agent evaluation, this conversation illuminates the evolving landscape of AI search.

Jeff Huber, Co-founder and CEO of Chroma, shares insights from his decade in applied machine learning. He discusses how small, opinionated teams with low egos create the best developer tools, emphasizing that consensus stifles innovation. Jeff critiques the RAG approach, introduces the concept of context engineering, and outlines Chroma’s strategy of keeping their core open source while monetizing complementary services. He also highlights the importance of design, company culture, and the mission to democratize AI-powered services.