
Prediction Market FAQ
Astral Codex Ten Podcast
00:00
Qualitative Criteria for AI Systems
We will define an AI system as a single unified software system that can satisfy the following criteria, all completeable by at least some humans. It must be able to reliably pass a two-hour adversarial Turing test during which the participants can send text, images and audio files. Has general robotic capabilities of the type able to autonomously when equipped with appropriate actuators? Satisfactorily assemble a circa 2021 Ferrari 312 T4 1-8 scale automobile model? A top one strict accuracy of at least 90% on interview level problems found in the APPS benchmark introduced by Dan Hendrix,. Or three, judgment by a majority vote in a special committee composed of the question author and two AI experts
Transcript
Play full episode