AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Theories of Everything with Curt Jaimungal
Daniel Schmachtenberger: Ai Risks & The Metacrisis
May 17, 2023
Daniel Schmachtenberger, a systems thinker and co-founder of the Consilience Project, dives into pressing issues like the risks of AI and nuclear threats. He emphasizes the importance of understanding the metacrisis, examining the unsustainable nature of exponential economic growth. The podcast also discusses how consciousness relates to complex systems and the alignment problem of AI, advocating for ethical frameworks in technology. Schmachtenberger highlights the urgency of global cooperation to navigate the challenges posed by these advancements.
04:23:00
Episode guests
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Current economic system relies on unsustainable exponential growth post-World War II.
- AI technology introduces crucial global governance risks that require checks and balances.
- Evolution of political systems struggles to keep pace with rapid AI advancements.
- Ethical AI development requires aligning progress with responsible frameworks and proactive risk mitigation.
- Destruction of Tibetan Buddhism led to global spread of cultural values through tourism and production.
- Deep introspection and integration of conflicting desires are vital for aligning personal motives with collective well-being.
Deep dives
Economic Dependency on Exponential Growth
The podcast delves into the idea that the current economic system post-World War II has been reliant on exponential monetary growth, a model that is unsustainable in the long run.
Digital Growth Illusion
Discussions revolve around the misconception that digital growth offers a solution, as it still requires physical resources and has limitations tied to human attention and finite resources.
Unrealistic Interplanetary Escape Plan
The podcast challenges the notion that becoming an interplanetary species to evade resource limitations is feasible or ethically sound, highlighting the impracticality of such an endeavor.
The Impact of Unregulated AI on Global Governance
AI technology poses a significant challenge to global governance as it introduces risks that are crucial to address. The need for checks and balances in the development and implementation of AI technologies becomes evident to prevent undesirable outcomes. The episode underscores the importance of understanding the risk space of AI and highlights the complexities involved in regulating AI on a global scale. The conversation delves into the necessity of designing systems that can adapt to an ever-changing technological landscape to avert potential risks and ensure ethical development and deployment of AI.
Dilemmas of Political Systems in Addressing AI Risks
The discussion touches upon the evolution of political systems, emphasizing the challenges they face in keeping pace with the rapid advancements in AI technology. It reveals the historical rationale behind the creation of democratic structures to check concentrated power and highlights how the changing technological landscape and AI advancements challenge the effectiveness of existing governance models. Additionally, the episode examines the imbalance between technological advancements and ethical considerations, questioning the sustainability of current political structures in managing AI-related risks effectively.
Ethical Considerations and Adaptive Intelligence in Governance
The podcast delves into the ethical implications of AI development and its potential impact on society. It raises critical questions about building adaptive intelligence into governance systems to address the novel challenges posed by AI technologies. Furthermore, it explores the need for comprehensive frameworks that consider the dual-use nature of technologies, emphasizing the importance of proactive risk assessment and mitigation strategies. The episode underscores the necessity of aligning technological progress with ethical principles to ensure responsible and sustainable AI innovation.
Radical Impact of Tibetan Buddhism and Ayahuasca Dissemination
The podcast episode highlights the significant impact of Tibetan Buddhism's destruction in Tibet leading to the widespread dissemination of Buddhist ideals globally. Similarly, the discussion extends to the economic pressures on indigenous cultures due to the rising interest in ayahuasca and plant medicines, transforming into tourism and production. This dual perspective emphasizes how destruction can paradoxically spread cultural memes and values to a wider audience.
Challenges of Aligning Civilizational Stack and AI Risks
Exploring the complexities of aligning the civilizational stack, encompassing worldview, social structure, and infrastructure, presents a formidable task. The conversation delves into the competitive dynamics between diverse civilizational paradigms vying for dominance and resources, leading to a global topology of self-termination. Additionally, the episode delves into the risks posed by artificial general intelligence (AGI) due to its unique omnipurpose potential in reshaping various technologies and the exponential development trends stemming from hardware to cognitive architectures.
Ethical Considerations and Fiduciary Responsibility in AI Development
The podcast episode raises profound ethical questions surrounding AI alignment and development, reflecting on the challenges of defining 'good' in alignment with human values. The discussion delves into the concept of a fiduciary responsibility within AI development, echoing the need to ensure AI systems are aligned with human well-being rather than exploiting asymmetries of power. It critically explores the impact of AI, such as social media algorithms, on personal information and behavior, advocating for a shift towards ethical fiduciary relationships to safeguard against undue influence and externalized harms.
Game Theory, Asymmetry of Power, and Technological Impact
Delving into the philosophical and ethical implications of technological advancement, the episode navigates the challenges of aligning AI development with human intentions and well-being. The discourse touches on the role of game theory in guiding technological power shifts and the necessity of addressing asymmetries of power in AI governance and regulation. It underscores the vital need for a comprehensive ethical framework to guide the exponential growth of technology and ensure alignment with human values and societal well-being.
Understanding the Affordances of Technology
Technology presents certain affordances that can be leveraged for various purposes, ranging from positive contributions like building homes for the homeless to destructive actions such as using it as a weapon. The development and utilization of technology are influenced by the motivational landscapes of individuals and societies. Every technology interacts with other tech in complex ecosystems, shaping the combinatorial potential and outcomes. Considerations for the multipolar trap that emerges highlight the need to evaluate the motives driving tech usage beyond individual intentions.
Alignment Challenges in Human Behavior and Tech Development
The alignment of human intentions with collective well-being involves a deep introspective look at individual motivations and conflicting desires. Psychological health is viewed through the lens of integrating conflicting parts of the self towards synergistic strategies. Analogies drawn between the conscious self and a cancer cell illustrate the importance of aligning personal motives with the greater good to avoid self-terminating paths. Discussions on cultural enlightenment and the evolution of values emphasize the need for societal alignment towards sustainability and ethical governance in the face of exponential technological growth.
Importance of Aligning Daily Choices with Core Values
It is crucial to design daily activities that align with one's core values and deepest beliefs. By configuring life to continuously reflect the true definition of good and beauty, individuals can ensure that their choices are informed by what truly matters to them. Prioritizing a meaningful connection to nature and genuine human interactions alongside awareness of global issues can instill a sense of purpose and responsibility in daily decision-making.
Urgency of Education and Bias Correction in Addressing Societal Challenges
Increasing awareness and understanding of pressing societal concerns is essential for informed decision-making. By actively seeking education on both preferred viewpoints and opposing perspectives, individuals can mitigate biased decision-making. Furthermore, engaging with diverse opinions and staying informed allows for a more nuanced approach to addressing complex challenges for a more sustainable future.
https://youtu.be/g7WtcTATa2U
Visit HENSONSHAVING.com/EVERYTHING to pick the razor for you and use code EVERYTHING and you’ll get two years' worth of blades free with your razor – just make sure to add them to your cart.
- *New* TOE Merch: https://tinyurl.com/TOEmerch
- Patreon: https://patreon.com/curtjaimungal
- Crypto: https://tinyurl.com/cryptoTOE
- PayPal: https://tinyurl.com/paypalTOE
- Twitter: https://twitter.com/TOEwithCurt
- Discord Invite: https://discord.com/invite/kBcnfNVwqs
- iTunes: https://podcasts.apple.com/ca/podcast/better-left-unsaid-with-curt-jaimungal/id1521758802
- Pandora: https://pdora.co/33b9lfP
- Spotify: https://open.spotify.com/show/4gL14b92xAErofYQA7bU4e
- Subreddit r/TheoriesOfEverything: https://reddit.com/r/theoriesofeverything
LINKS MENTIONED:
- Iain McGilchrist on TOE: https://youtu.be/M-SgOwc6Pe4
TIMESTAMPS:
00:00:00 Overview of Daniel's Worldview and Introduction
00:05:13 Nash Equilibrium
00:09:05 Quasiprobability Distributions, Quantum Mechanics, & Wigner
00:13:26 The Metacrisis
00:30:53 Exponential and Unsustainable Economic System
00:54:44 Synopsis so-far
00:58:43 Classifying Different Civilizational Risks
01:22:28 Natural Selection on Altruistic Religions
01:53:16 The "Risk Space" of Ai
02:32:59 Paperclip Maximizer Scenario
02:37:31 "Finitely Describing What's 'Good'" is the Alignment Problem
03:37:53 Iain McGilchrist, John Vervaeke, and the Metacrisis
03:42:27 David Bohm's Connected Consciousness ("Implicate Order")
03:44:22 Explications on Phenomenal Consciousness (Gregg Henriques)
04:01:34 Geoffrey Hinton, Yejin Choi, and OpenAI on Ai
04:11:33 Daniel's Message to the Audience
Learn more about your ad choices. Visit megaphone.fm/adchoices
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode