3min chapter

The Thesis Review cover image

[45] Luke Zettlemoyer - Learning to Map Sentences to Logical Form

The Thesis Review

CHAPTER

The Importance of Absolute Performance in Language Models

I had another question about the absolute performance of a model and yeah let me unpack this a bit so if we go back to what you mentioned about the APIs then we might have a really powerful API that we can access but we actually don't really know what's going on behind the scenes. So as a research community is it okay to not worry about the absolute number and say like well we understand this one better? Is that kind of an okay state of affairs to have for research if that makes sense?""Yeah I think it's absolutely okay," he said. "You want actually way more of the understanding and careful study than you want of the like chasing the state-of-the

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode