Microsoft Research Podcast cover image

AI Frontiers: The Physics of AI with Sébastien Bubeck

Microsoft Research Podcast

00:00

The Limits of the GPT-4 Model

GPT-4 is a large language model, which was trained on the next word prediction objective function. It just means you give it a partial text, and you're trying to predict what is going to be the next word in that partial text. The system is not able to do this kind of long-term planning for example. These are very, very serious limitations in particular for mathematics.

Play episode from 20:04
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app