The Challenges of Scaling Language Models

There's a lot of interesting research left to be done in language models. The big models like chat, TPM, so far that many people have tried out these kind of models are going to have similar intelligence as we put into the poker and diplomacy boss. And I think this is really important because if you look at the cost of how much it costs to train these language models today, it's really expensive. Very curious to see that all play out.