The Sentience Institute Podcast cover image

Raphaël Millière on large language models

The Sentience Institute Podcast

00:00

The Power of Next Word Prediction

GPT-3 and GPT-4 are models that can do a really remarkable range of things. They learn a lot in the process of doing next word prediction very well, but researchers are still trying to find out exactly what kinds of capacities or computations they learn. In order to become so good in all of these different contexts,These models are superhuman and unexplored prediction compared to humans who do much better at predicting the next word.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app