The Trajectory Joe Carlsmith - A Wiser, AI-Powered Civilization is the “Successor” (Worthy Successor, Episode 15)
8 snips
Nov 14, 2025 
In this discussion, Joe Carlsmith, a senior advisor formerly at Open Philanthropy and an Oxford Ph.D., dives into the concept of civilization-level stewardship. He posits that AI should not replace humanity but serve as a tool for enhancing our wisdom and philosophical clarity. Joe explains the potential for unheard values beyond our current understanding, critiques the moral implications of evolution, and stresses the importance of regulating AI to prevent existential risks. His insights on AI traits and civilizational goals are thought-provoking and essential for future discourse.
AI Snips
Chapters
Books
Transcript
Episode notes
Starts With Intellectual Humility
- Joe opens by admitting he can't recognize a final 'good future' from today and values traits on the path instead.
- He cites consciousness, joy, love and beauty as likely components but focuses on virtues that lead toward them.
Humility About Far-Future Values
- Joe believes our minds are a "radically impoverished" way to access value, so future goods likely exceed our current imagination.
- He prioritizes identifying intermediate virtues and processes that lead toward better futures rather than predicting final states.
Values May Be Hominid‑Anchored
- Joe argues metaethical value may be partly grounded in human psychology, making future values hominid-relative even if alien in content.
- He expects we could recognize new values after suitable reflection and growth originating from our psychology.
