"Age of Miracles" cover image

Anton Teaches Packy AI | E1

"Age of Miracles"

00:00

Is It Order Regressive?

So when it makes multiple predictions, that's what it's doing. It's like selecting, selecting lower down the probability tree and then making more predictions off of, off of that token. But this is order regressive. So for simplicity's purpose, we're going to say like, it's going to take the most likely prediction. Now, you notice that this also looks a lot like the input that's got the position encoding. The position encoding is just about what place you're in, not if you've ended the sentence or not.

Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner