3min chapter

Mystery AI Hype Theater 3000 cover image

Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022

Mystery AI Hype Theater 3000

CHAPTER

The Resurgence of Old School Linguistics Tools

This is a fairly crude resurgence of the old, old school linguistics techniques. It's not really an answer to what kinds of dialects people actually use. And I want to add back to my grumbling about this sort of massive tensor. If you were going to swap out the scenario so that you could move to another language, you would be able, in principle, to do all of this stuff with another language. Most of your metrics are themselves language dependent. So now you have to swap out your scenarios to do because you can't do this pronoun perturbation in German.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode