"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis cover image

The Customer Service Revolution: Building Fin, with Eoghan McCabe & Fergal Reid of Intercom

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

00:00

How do you evaluate new models and run evals?

Nathan asks about eval stacks; Fergal explains mature backtests, skepticism of offline evals, and the primacy of large-scale production A/B tests.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app