Simon Knowles on pushing AI computing to the limit by rethinking chips
The Robot Brains Podcast
Neural Networks - The Transformer
We bet that the data structures in the end would need to be grafts of great complexity. I think actually the neural network world, that we didn't anticipate being quite so pervasive, is now moving in that direction. They may be at their alex net moment. W to me, we've had two alex net moments so far. We've had the alex net moment itself, and then we've had the break out of transform. Almost the second one was interesting. It was the fact that you that that structure could harness unsupervised learning that was interesting thing. And under the hood, the transformer is quite different from the previous types of nera that work.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
