
Anton Teaches Packy AI | E1
"Age of Miracles"
The Core Architecture in a Transformer
A lot of what's been innovated lately is mostly about making this more efficient and understanding what it's actually doing. The core architecture in a transformer is this encoder decoder pair. So an encoder to the left side of this where you're looking at the left column basically is the encoder and the right side is the decoder. And so it's a good idea to probably talk about like what's actually being encoded.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.