The Gradient: Perspectives on AI cover image

Yoshua Bengio: The Past, Present, and Future of Deep Learning

The Gradient: Perspectives on AI

00:00

The Action Side of Machine Learning

In the last few years, I delved quite a bit in reinforcement learning and started to publish in that area. There's a whole aspect of machine learning that we didn't talk about, which becomes really important when you start thinking about causality - action side of things. So attention is central to this whole story, and there's still a lot that we don't understand. When we introduce attention in our 2014 paper on machine translation that had a huge impact on machine translation and then natural language processing, we used what we call soft attention. We actually focus on several ones with a mix, a convex combination. But it's not that we humans do it. The necro cube is

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app