The Aarthi and Sriram Show cover image

EP 31 Noam Shazeer - Google veteran and AI inventor on future of AI

The Aarthi and Sriram Show

00:00

Is Google Translate the Next Big Thing?

Yaka: The idea was to do a neural network for text that has where you're using parallel processing and you could process the whole sequence in parallel, at least during training time. So this attention layer means, okay, you take your source sentence and you sort of turn it into like this associative memory. And then when you're generating something you kind of generate the specter that's a query, and then you compare the query to all the keys, and they find what matches well. Yaka: I think one of our biggest inspirations is Google Translate. We were trying to build an intuitive computer science system which we can build an understanding of.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app