11min chapter

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

Language Understanding and LLMs with Christopher Manning - #686

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

CHAPTER

Revolutionizing NLP with Word Embeddings and Transformers

The chapter explores the impact of word embeddings on NLP tasks, emphasizing their role in capturing word meanings and relationships effectively. It delves into the transition from word vectors to contextual representations in modern language models and discusses the advancements in utilizing large language models for NLP progress. The conversation also covers the evolution of attention mechanisms in neural networks, particularly focusing on the breakthrough of attention in improving tasks like machine translation, question answering, and summarization.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode