1min chapter

The Robot Brains Podcast cover image

Simon Knowles on pushing AI computing to the limit by rethinking chips

The Robot Brains Podcast

CHAPTER

Neural Networks - The Transformer

We bet that the data structures in the end would need to be grafts of great complexity. I think actually the neural network world, that we didn't anticipate being quite so pervasive, is now moving in that direction. They may be at their alex net moment. W to me, we've had two alex net moments so far. We've had the alex net moment itself, and then we've had the break out of transform. Almost the second one was interesting. It was the fact that you that that structure could harness unsupervised learning that was interesting thing. And under the hood, the transformer is quite different from the previous types of nera that work.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode