Microsoft's Bold Move with Fabric and AI Integration with Henry Habib
The Analytic Mind
00:00
The Limitations of GPT Models
GPT models struggle with math and logical reasoning because they're a probabilistic model, right? That's why you have to pair them with other sort of tools to kind of make them worth it. I think one of the biggest limitations that GPT faces right now is really the number of tokens that I can handle at once. Right now, the standard GPT model has 4K tokens. You can only put in 4000 data points for words or, you know, obviously there's a range there. But imagine if it had like, and they're working for this and I'm sure we'll get there one day,. Think about how much processing that it can do.
Play episode from 28:05
Transcript
