Scaling Parameters for Large Language Models

The data will be very clear, you know, a word in a sentence. You can look at that and take some meaning out of it. We talk a lot about parameters and scaling parameters. What does parameters mean in the scale in the context of large language models? And how should people think about how hard or easy it is to scale up these parameters for these models? Yeah,. The parameters are just more layers, like wider layers in the model. So in this case, this is our transformers. And the layers are either like these attention head layers, or these like multi layer perceptron layers. It's actually interesting, the majority of the compute is the MLP layers and not