[45] Luke Zettlemoyer - Learning to Map Sentences to Logical Form
The Thesis Review
The Potential Shift From Scaling a Model to Understanding Data Quality
I think we're pretty early in that and even understanding the chinchilla results I mean I think this area has become you know so hard. At that scale we've trained like 10 models ever or something right and everything changed between each run but it's a really exciting time to see those different studies published. It seems very intuitive that more data should help but it's also different data they used so how does data quality factor into that ratio? The jury is still out and we need like way more work to try to understand all this.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
