
AI Frontiers: The Physics of AI with Sébastien Bubeck
Microsoft Research Podcast
00:00
The Limits of the GPT-4 Model
GPT-4 is a large language model, which was trained on the next word prediction objective function. It just means you give it a partial text, and you're trying to predict what is going to be the next word in that partial text. The system is not able to do this kind of long-term planning for example. These are very, very serious limitations in particular for mathematics.
Play episode from 20:04
Transcript


