Benjamin Klieger

Benjamin Klieger, the lead engineer at Groq, shares insights on AI agent infrastructure. He discusses the groundbreaking Compound agent that effectively searches the web and executes tasks quickly. Benjamin explains how Groq’s custom LPU hardware allows for lightning-fast inference, transforming a one-minute process into mere seconds. He also touches on the importance of dynamic evals and real-time datasets, critiquing traditional benchmarks for their lack of novelty. Join him as he explores the future of efficient AI agents and the metrics that define their success.