"Age of Miracles" cover image

Anton Teaches Packy AI | E1

"Age of Miracles"

CHAPTER

The Core Architecture in a Transformer

A lot of what's been innovated lately is mostly about making this more efficient and understanding what it's actually doing. The core architecture in a transformer is this encoder decoder pair. So an encoder to the left side of this where you're looking at the left column basically is the encoder and the right side is the decoder. And so it's a good idea to probably talk about like what's actually being encoded.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner