3min chapter

Gradient Dissent: Conversations on AI cover image

Emily M. Bender — Language Models and Linguistics

Gradient Dissent: Conversations on AI

CHAPTER

Is There a Future for Language Models?

Language models have been an important component of language technology since Shannon's work in the 1950s. People are going to find that putting language models at the center of something where your application really requires you to have a commitment to accountability for the words that are uttered is going to be a very fragile way to go. And so my guess is that when we get to that point, we're going to decentralize the language models and have them be something that is selecting among cosplay outputs again or providing these word embeddings. But they are not a step towards general purpose language understanding the way they're hyped to be.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode