How Does AI Work? (Robert Wright & Timothy Nguyen)
Robert Wright's Nonzero
00:00
The Importance of Vectors in Words
The text is broken down into tokens which are not exactly the same as words. And then you can see that at the very beginning of the process, the text is converted into mathematical reform right. So the tokens can take before the tokens are converted into numbers and then subjected to all this math. But it's a little puzzling to me why like two consecutive letters in a word turns out to be meaningful from the point of view of the model right.
Transcript
Play full episode
