The Evolution of NLP Models

Today we’re joined by David Carmona, General Manager of Artificial Intelligence & Innovation at Microsoft. 

In our conversation with David, we focus on his work on AI at Scale, an initiative focused on the change in the ways people are developing AI, driven in large part by the emergence of massive models. We explore David’s thoughts about the progression towards larger models, the focus on parameters and how it ties to the architecture of these models, and how we should assess how attention works in these models.

We also discuss the different families of models (generation & representation), the transition from CV to NLP tasks, and an interesting point of models “becoming a platform” via transfer learning.

The complete show notes for this episode can be found at twimlai.com/go/465.