AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Predict the Next Word in a Sequence
We will eventually train something that has read as much of the internetor more of the internet, than we've done right now. We have very long way to go. Anywere still, i think, relative to what we will have, operating a quite small scale with quite small as but what is happening is there is a model that is in jesting lots of texts, and it is trying to predict the next word. M so we use transformers. They take in a context, which is a particular architecture of an a i model. And they try to predict the word that comes next in the sequence. There's like a lot of other things that happen,. But fundamentally, that's