AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Predicting the Next Word
The language s that we have right now, gpt, three and so on, a, which everyone is very excited about. Ah, but what they're really doing is predicting the next word based on all the previous words that were in the text sequence. And it's a little bit like a astronomy in the time of ptolemy - i'm going to predict what it's going to be in two words, three words, forwards into the future. The real cause of why that word is ther because, ah, there's a world outside thisin the text, and someone is trying to say something about it. A and that's sort of what i call the physics of text