Robinson's Podcast cover image

124 - Jay McClelland: Deep Learning, Neural Networks, and Artificial Intelligence

Robinson's Podcast

00:00

The Power of the Transformer

The transformer was initially introduced by Fuswani at all. They weren't inventing it but they kind of perfected a module that had this transformer architecture and they used it for a particular purpose. So the really beautiful little setup of this paper I suppose I have a sentence he walked to the bank of the river and I want to translate that into French. It seems like the transformer plays an analogous role in some ways as central governing or memory like feature of human brain.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app