Alec Radford: I remember being impressed that you could take a model and get it to do two or three of these very simple, very stilted language tasks at once. But we made this realization near the end of 2018 that, hey, you just keep scaling these things. They just kind of can absorb the capacity. And then they can do all kinds of things just as a side effect of you feeding this data into them to get them to predict the next word. It's completely crazy if you look at it, which is why even though the extrapolations were clear as day, it seemed crazy to me.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode