How to Improve Machine Learning Algorithms

The big data strategy is just get more and more data to build your models. Then the second one is to throw a lot of computational power at it. And then the algorithm is just kind of a tripped out version of a deep neural net, which we've already had. So that's the idea of GPT2 to GPT3.