AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Risks of Ever Larger Language
Sally McConnell-Jane's argument is, you get from one meaning to the other through a series of pejorative uses over time. So yes, absolutely meaning is use, but use isn't just distribution and text. Use is embedded in a social context, it's embedded in communicative intent. But these language models, so GPT2, GPT3, et cetera, they're only training data is the form. The only thing they have access to is the distribution of word forms and text.