The Importance of Scaling Language Models

There's a ton of things that we can... And this is a huge area right now, the generation. I think one of the reasons that these language models are so exciting is that for the first time you can actually generate large coherent paragraphs. There's also images which actually we're thinking about moving into that space as well. So has the NLP research community kind of settled on what's the threshold before you call something large? You know, I've actually stopped calling saying that we're large. Because to your point, what's large is 1 billion large is 100 billion large.