AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is Language Infinite?
I feel like people actually often overstate the importance of language being infinite. You get really complicated, no interestingly complicated phenomena just looking at finite lengths of sentences. I don't thing you need to go to infinity to make these kinds of arguments. The language we probably use is, i mean, it's o. There's a long tale of mean, the infinity is not something we ever probably come across yet. It's bintorial e. And neural networks are literally locality sensitive hashing tables. So there's just a complete disparity between the domain of language and the capacity of your model to learn it.