Is There a Future for Language Models?

Language models have been an important component of language technology since Shannon's work in the 1950s. People are going to find that putting language models at the center of something where your application really requires you to have a commitment to accountability for the words that are uttered is going to be a very fragile way to go. And so my guess is that when we get to that point, we're going to decentralize the language models and have them be something that is selecting among cosplay outputs again or providing these word embeddings. But they are not a step towards general purpose language understanding the way they're hyped to be.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.