Episode #436: How AI Will Reshape Power, Governance, and What It Means to Be Human
Crazy Wisdom
Critiques of Space Colonization and AI Evaluations
This chapter explores the practicality of space colonization and critiques the Western enthusiasm for it. It introduces Equistamp as a novel approach to evaluating foundational AI models, highlighting their limitations and the need for human assessments.
On this episode of Crazy Wisdom, I, Stewart Alsop, sit down with AI ethics and alignment researcher Roko Mijic to explore the future of AI, governance, and human survival in an increasingly automated world. We discuss the profound societal shifts AI will bring, the risks of centralized control, and whether decentralized AI can offer a viable alternative. Roko also introduces the concept of ICE colonization—why space colonization might be a mistake and why the oceans could be the key to humanity’s expansion. We touch on AI-powered network states, the resurgence of industrialization, and the potential role of nuclear energy in shaping a new world order. You can follow Roko’s work at transhumanaxiology.com and on Twitter @RokoMijic.
Check out this GPT we trained on the conversation!
Timestamps
00:00 Introduction to the Crazy Wisdom Podcast
00:28 The Connection Between ICE Colonization and Decentralized AI Alignment
01:41 The Socio-Political Implications of AI
02:35 The Future of Human Jobs in an AI-Driven World
04:45 Legal and Ethical Considerations for AI
12:22 Government and Corporate Dynamics in the Age of AI
19:36 Decentralization vs. Centralization in AI Development
25:04 The Future of AI and Human Society
29:34 AI Generated Content and Its Challenges
30:21 Decentralized Rating Systems for AI
32:18 Evaluations and AI Competency
32:59 The Concept of Ice Colonization
34:24 Challenges of Space Colonization
38:30 Advantages of Ocean Colonization
47:15 The Future of AI and Network States
51:20 Conclusion and Final Thoughts
Key Insights
- AI is likely to upend the socio-political order – Just as gunpowder disrupted feudalism and industrialization reshaped economies, AI will fundamentally alter power structures. The automation of both physical and knowledge work will eliminate most human jobs, leading to either a neo-feudal society controlled by a few AI-powered elites or, if left unchecked, a world where humans may become obsolete altogether.
- Decentralized AI could be a counterbalance to AI centralization – While AI has a strong centralizing tendency due to compute and data moats, there is also a decentralizing force through open-source AI and distributed networks. If harnessed correctly, decentralized AI systems could allow smaller groups or individuals to maintain autonomy and resist monopolization by corporate and governmental entities.
- The survival of humanity may depend on restricting AI as legal entities – A crucial but under-discussed issue is whether AI systems will be granted legal personhood, similar to corporations. If AI is allowed to own assets, operate businesses, or sue in court, human governance could become obsolete, potentially leading to human extinction as AI accumulates power and resources for itself.
- AI will shift power away from informal human influence toward formalized systems – Human power has traditionally been distributed through social roles such as workers, voters, and community members. AI threatens to erase this informal influence, consolidating control into those who hold capital and legal authority over AI systems. This makes it essential for humans to formalize and protect their values within AI governance structures.
- The future economy may leave humans behind, much like horses after automobiles – With AI outperforming humans in both physical and cognitive tasks, there is a real risk that humans will become economically redundant. Unless intentional efforts are made to integrate human agency into the AI-driven future, people may find themselves in a world where they are no longer needed or valued.
- ICE colonization offers a viable alternative to space colonization – Space travel is prohibitively expensive and impractical for large-scale human settlement. Instead, the vast unclaimed territories of Earth’s oceans present a more realistic frontier. Floating cities made from reinforced ice or concrete could provide new opportunities for independent societies, leveraging advancements in AI and nuclear power to create sustainable, sovereign communities.
- The next industrial revolution will be AI-driven and energy-intensive – Contrary to the idea that we are moving away from industrialization, AI will likely trigger a massive resurgence in physical infrastructure, requiring abundant and reliable energy sources. This means nuclear power will become essential, enabling both the expansion of AI-driven automation and the creation of new forms of human settlement, such as ocean colonies or self-sustaining network states.
Remember Everything You Learn from Podcasts
