EP 31 Noam Shazeer - Google veteran and AI inventor on future of AI
The Aarthi and Sriram Show
00:00
Is Google Translate the Next Big Thing?
Yaka: The idea was to do a neural network for text that has where you're using parallel processing and you could process the whole sequence in parallel, at least during training time. So this attention layer means, okay, you take your source sentence and you sort of turn it into like this associative memory. And then when you're generating something you kind of generate the specter that's a query, and then you compare the query to all the keys, and they find what matches well. Yaka: I think one of our biggest inspirations is Google Translate. We were trying to build an intuitive computer science system which we can build an understanding of.
Transcript
Play full episode
