Future of Life Institute Podcast cover image

Joe Carlsmith on How We Change Our Minds About AI Risk

Future of Life Institute Podcast

CHAPTER

Benchmarks for AI Progress

GPT-4 passed high school exams, getting As in high school exam, passing the bar exam. Does this mean that the GPT-4 is now suddenly as capable as a human lawyer? I do think there's a general history of it being somewhat difficult to specify ahead of time the tasks that will be law degree meaningful with respect to AI progress. We shouldn't underestimate how much weight people put on chess as they're kind of like the upper end of human intellectual achievement in before it was basically a solved problem in AI.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner