AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Language Models
A recent essay by Stefan Wolfram argues the success of large language models is evidence for your theory of language. He says their means are otherwise too limited to be successful. But you say this is partly true, but partly misleading. Large language models have a fundamental property which demonstrates that they cannot tell you anything about language and thought. They work just as well for impossible languages as for possible languages. So therefore, in principle, it's telling you nothing about language. You can take a smartest chimpanzee or the dogs under my desk, they can listen to this noise forever. That's a fundamental property of humans built in.