AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is Attention All You Need?
The most seminal paper in the last several years, when it comes to feel of AI is attention is all you need. The idea of transformers and self attention was at the heart of really has been the foundation of so much of the advances that we've seen over the last few years. So maybe let's start at the basics again. What is a transformer? What is attention and let's go from there.