AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
GPT Three Scaling Law Papers - Is GPT 3 Scaling Better?
Google put out a research paper about their model called Lambda, which I think has even more parameters than GPT three. They made this diagram of this like ballooning of activities. So as you scale up the model, the model gets become better. Like these balloons emerge where it gets better at things like translation. New ones appear. And so if you're interested to sort of plan somehow at like a medium long term, the research is there that should maybe give you some indication of the models as the improved medium term.