The Benchmarks Are Not the Full Story, Right?

As the models get better and better, it's going to be hard to measure how good they are. Already there are models that out perform humans on certain bench marks. But just because something is great at a bench mark, we're not done. Even things that perform well on bench marks may fail spectacularly in a lot of ways. And i don't think we need to think very hard for some examples, like microsop te.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app