The Data Centric Approach to Scaling Large Language Models

I thought you would be more excited about large language models, because that, in effect, is data centric approach. You're just scaling up the amount of data and training that the model can handle. A i has been in the error of big data for the last decade. Nothing wrong with that. Veoll the data. Wny, have alarte data. Let's keep doing that. But because not everyone has giant data, says, i think a ey needs a new direction in addition to big data - which is a movement to o good data.