Navigating Post-AGI Governance Challenges

19min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

This chapter explores the critical issues surrounding post-AGI governance, touching on understanding explosive AI growth, moral considerations of digital entities, resource governance post-intelligence explosion, and the challenges of preventing power seizure by small actors. The focus is on fostering a deliberative process amidst this rapid AI advancement. Suggestions are made for a structured pause in AI development to collectively strategize the future with advanced AI assistance.

Read the full transcript here.

What are the facts around Sam Bankman-Fried and FTX about which all parties agree? What was the nature of Will's relationship with SBF? What things, in retrospect, should've been red flags about Sam or FTX? Was Sam's personality problematic? Did he ever really believe in EA principles? Does he lack empathy? Or was he on the autism spectrum? Was he naive in his application of utilitarianism? Did EA intentionally install SBF as a spokesperson, or did he put himself in that position of his own accord? What lessons should EA leaders learn from this? What steps should be taken to prevent it from happening again? What should EA leadership look like moving forward? What are some of the dangers around AI that are not related to alignment? Should AI become the central (or even the sole) focus of the EA movement?

William MacAskill is an associate professor in philosophy at the University of Oxford. At the time of his appointment, he was the youngest associate professor of philosophy in the world. He also cofounded the nonprofits Giving What We Can, the Centre for Effective Altruism, and 80,000 Hours, which together have moved over $300 million to effective charities. He's the author of What We Owe The Future, Doing Good Better, and Moral Uncertainty.

Further reading: