Artificial Intelligence and You cover image

143 - Guest: Melanie Mitchell, AI Cognition Researcher, part 2

Artificial Intelligence and You

00:00

Chat GPT Isn't Testing the Ability to Generalize Robustly

Chat GPT has scored at the 52nd percentile on a test designed for humans. But that doesn't mean it can generalize robustly, as humans often do. Some people have published wonderful results with chat GPT that I've attempted to reproduce and haven't happened. That shows that some of these tests are not testing the abilities that we want them to test.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app