How Far Will Language Modelling Take Us?

Unsupervised language modelling has already gone further than many expected, says Yetta. We need more than what we're seeing with language models to solve the turring test, she argues. How different will that be from what we already do? That's an open question. But i think there's a lot of really interesting angles to poke in terms of how much does gpt two understand physical world.