Behind the Craft cover image

AI Evaluations Crash Course in 50 Minutes (2025) | Hamel Husain

Behind the Craft

00:00

Why agreement metrics can be misleading

Hamel warns against reporting raw agreement and explains why rare failure rates make agreement a deceptive metric.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app