AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Power of Transformers in Machine Learning
Transformers give us the power to better leverage computation that we already have. But their optimization problem is much easier than the previous best approach for processing sequences. With a little bit of work, it will be possible to bring back recurrent neural networks and make them competitive with transformers.