Get the app
Bryan Bischoff
Data scientist and practitioner who contributed the 'Failure as a Funnel' approach for diagnosing complex, agentic AI systems; appears as a guest caller to discuss analytical techniques for evals.
Best podcasts with Bryan Bischoff
Ranked by the Snipd community
94 snips
Sep 30, 2025
• 1h 13min
Episode 60: 10 Things I Hate About AI Evals with Hamel Husain
chevron_right
Hamel Husain, a machine learning engineer and evals expert, discusses the pitfalls of AI evaluations and how to adopt a data-centric approach for reliable results. He outlines ten critical mistakes teams make, debunking ineffective metrics like 'hallucination scores' in favor of tailored analytics. Hamel shares a workflow for effective error analysis, including involving domain experts wisely and avoiding hasty automation. Bryan Bischoff joins as a guest to introduce the 'Failure as a Funnel' concept, emphasizing focused debugging for complex AI systems.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
Get the app