CNNs in the 90s were very well kind of motivated by human perception when they came out actually in the 80s. Whereas transformers are a bit more of a sort of just discovery that happened. And so I guess there would be some hope that if we do more of these kinds of studies, you know, what is the next transformer? Maybe we can have a more principled way to figure that out and find this next architecture.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode