Mystery AI Hype Theater 3000 cover image

Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022

Mystery AI Hype Theater 3000

CHAPTER

The Resurgence of Old School Linguistics Tools

This is a fairly crude resurgence of the old, old school linguistics techniques. It's not really an answer to what kinds of dialects people actually use. And I want to add back to my grumbling about this sort of massive tensor. If you were going to swap out the scenario so that you could move to another language, you would be able, in principle, to do all of this stuff with another language. Most of your metrics are themselves language dependent. So now you have to swap out your scenarios to do because you can't do this pronoun perturbation in German.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner