Unsupervised Learning with Jacob Effron cover image

Ep 80: CEO of Surge AI Edwin Chen on Why Frontier Labs Are Diverging, RL Environments & Developing Model Taste

Unsupervised Learning with Jacob Effron

00:00

Benchmarks vs. Human Evaluations

Edwin argues benchmarks can be gamed and advocates rigorous human evals with expert raters to measure real progress.

Play episode from 07:30
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app