Y Combinator Startup Podcast cover image

Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI

Y Combinator Startup Podcast

00:00

Why Autoregressive Language Modeling Won Out

Ankit asks why autoregressive objectives dominated; Nick discusses empirical testing, sampling advantages, and loss as a metric.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app