
Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI
Y Combinator Startup Podcast
00:00
Why Autoregressive Language Modeling Won Out
Ankit asks why autoregressive objectives dominated; Nick discusses empirical testing, sampling advantages, and loss as a metric.
Transcript
Play full episode