Most Technologies Aren't Races
Astral Codex Ten Podcast
00:00
The Importance of Alignment in AI
Everyone I know who believes in fast take-offs is a doomer. There's no way you go to sleep with a normal, only slightly above human-level AI. You have no chance to debug the AI at level N and get it ready for N plus one. If you're sure these kinds of things won't happen, then you should treat AI like electricity, automobiles, or stealth bombers. It might tip the balance of a badly timed war, but otherwise you can just steal the tech and catch up. And in the scenarios where you do need to win races, you really want to worry about alignment.
Transcript
Play full episode
