Introduction

This episode's topic is attention. You know what this word means, but it's now being used in a very special way in machine learning. Attention mechanisms are being introduced to learning algorithms and its surprisingly good results. This is especially true in natural language processing. It makes it possible for machine learning to find solutions that are able to identify key pieces of information to retain.