
[45] Luke Zettlemoyer - Learning to Map Sentences to Logical Form
The Thesis Review
The Importance of Absolute Performance in Language Models
I had another question about the absolute performance of a model and yeah let me unpack this a bit so if we go back to what you mentioned about the APIs then we might have a really powerful API that we can access but we actually don't really know what's going on behind the scenes. So as a research community is it okay to not worry about the absolute number and say like well we understand this one better? Is that kind of an okay state of affairs to have for research if that makes sense?""Yeah I think it's absolutely okay," he said. "You want actually way more of the understanding and careful study than you want of the like chasing the state-of-the
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.