Dwarkesh Podcast cover image

Dario Amodei — "We are near the end of the exponential"

Dwarkesh Podcast

00:00

Pretraining Across Wide Data Enables Generalization

  • Pre-training on a broad distribution yields surprising generalization not seen in narrow corpora.
  • In-context learning gives models rapid short-term adaptation that complements long pre-training.
Play episode from 07:04
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app