124 - Jay McClelland: Deep Learning, Neural Networks, and Artificial Intelligence
Robinson's Podcast
00:00
The Importance of the Macro Structure of the Neural Network
The macro structure of the neural network is a little bit more about how you organize those elementary computations. The transformer architecture was one that I guess really brings home how a fairly subtle change in the way you organize the computation can dramatically increase its effectiveness. So we probably don't want to go into the technical details of exactly how a transformer works but it makes it possible to have a pattern of activation at a set of one set of let's say 128 or maybe it's 10,024 neural like processing units.
Transcript
Play full episode
