
5. Charlie Snell on DALL-E and CLIP
The Inside View
What's So Powerful About the Transformer?
Dali: So for Dali, basically the transformers, like the brain, like it's the part that's generating the image. Um, well, I think maybe there's maybe some progress being made, but I think it's still largely an open question of like, you know, the fundamental reason like what is it that makes the transformer so powerful? He says nobody knows exactly why transformers work so well. And then he will ask questions about his overall takes on deep learning and stuff.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.