The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Trends in Natural Language Processing with Sameer Singh - #445

Jan 7, 2021

Sameer Singh, Assistant Professor at UC Irvine and an expert in natural language processing, dives into the latest trends in NLP. He discusses the profound impact of GPT-3 and Transformer models on the field. The conversation highlights the complexities of evaluating language models and their practical vulnerabilities. Sameer brings attention to the limitations of current models in achieving true natural language understanding. Additionally, he shares insights on the intersection of language and vision models, shaping the future of NLP.

01:21:55

Creator website

Episode guests

Sameer Singh

AI Chapters

Episode notes

Intro

2min

Introspection in NLP: 2020 and Beyond

4min

Exploring GPT-3: Innovations and Implications

21min

The Evolution of Transformer Models in NLP

2min

Limits of Language Models in NLU

15min

Vulnerabilities of Language Models

14min

Reevaluating NLP Model Evaluation Techniques

22min

Looking Ahead: The Future of Natural Language Processing

2min

Today we continue the 2020 AI Rewind series, joined by friend of the show Sameer Singh, an Assistant Professor in the Department of Computer Science at UC Irvine.

We last spoke with Sameer at our Natural Language Processing office hours back at TWIMLfest, and was the perfect person to help us break down 2020 in NLP. Sameer tackles the review in 4 main categories, Massive Language Modeling, Fundamental Problems with Language Models, Practical Vulnerabilities with Language Models, and Evaluation.

We also explore the impact of GPT-3 and Transformer models, the intersection of vision and language models, and the injection of causal thinking and modeling into language models, and much more.

The complete show notes for this episode can be found at twimlai.com/go/445.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.