AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Potential Shift From Scaling a Model to Understanding Data Quality
I think we're pretty early in that and even understanding the chinchilla results I mean I think this area has become you know so hard. At that scale we've trained like 10 models ever or something right and everything changed between each run but it's a really exciting time to see those different studies published. It seems very intuitive that more data should help but it's also different data they used so how does data quality factor into that ratio? The jury is still out and we need like way more work to try to understand all this.