Words into Action | Progress from Large Language Models to AGI
Greymatter
00:00
Scaling Scalable Machine Learning
Scale definitely is helping. If you scale up the models, i think it lifts all boats. Then given a particular scale, then you have the question of where you're investing your resources. We don't really have a good handle on this quite yet. Having humans inaloop for kind of in interloop is also potentially problematic and hard, not reproducible. You want something that's easy to evaluate, but at the same time that's actually tracking what you care about.
Transcript
Play full episode
