AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
5min chapter
EP 31 Noam Shazeer - Google veteran and AI inventor on future of AI
The Aarthi and Sriram Show
Is Google Translate the Next Big Thing?
Yaka: The idea was to do a neural network for text that has where you're using parallel processing and you could process the whole sequence in parallel, at least during training time. So this attention layer means, okay, you take your source sentence and you sort of turn it into like this associative memory. And then when you're generating something you kind of generate the specter that's a query, and then you compare the query to all the keys, and they find what matches well. Yaka: I think one of our biggest inspirations is Google Translate. We were trying to build an intuitive computer science system which we can build an understanding of.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode