ForeCast

Will MacAskill, a philosopher and co-founder of 80,000 Hours, discusses his research series, ‘Better Futures.’ He delves into the importance of transitioning from mere survival to thriving in the face of existential risks. Topics include the interplay of human flourishing and ethical governance, the pursuit of an ideal future, and the complexities surrounding moral catastrophes. MacAskill emphasizes the need for collective action and philosophical reflection as we navigate the uncertain dynamics of AI and global challenges, shaping a more hopeful tomorrow.

Join Peter Salib, an expert in law and AI risk, and Simon Goldstein, a philosopher focusing on AI safety, as they explore the vital topic of AI rights. They discuss how establishing legal frameworks can prevent conflicts between humans and artificial intelligence. The conversation dives into the ethical implications of AI ownership and rights, touching on property laws and the importance of rights in fostering cooperation. They also examine the potential for AI to enhance human safety and welfare, raising critical questions about future governance and societal impact.

Toby Ord, a Senior Researcher at Oxford University focused on existential risks, dives into the intriguing concept of the ‘scaling paradox’ in AI. He discusses how scaling challenges affect AI performance, particularly the diminishing returns of deep learning models. The conversation also touches on the ethical implications of AI governance and the importance of moratoria on advanced technologies. Moreover, Toby examines the shifting landscape of AI's capabilities and the potential risks for humanity, emphasizing the need for a balance between innovation and safety.

Lizka Vaintrob discusses ‘AI Tools for Existential Security’, co-authored with Owen Cotton-Barratt. To see all our published research, visit forethought.org/research.

Tom Davidson, co-author of the influential paper on AI R&D automation, delves into the potential for a software intelligence explosion. He discusses how automated AI research could lead to a runaway feedback loop, surpassing human capabilities. The conversation covers the Asara concept, suggesting AI might autonomously enhance research, revolutionizing the field. Davidson also highlights the balance between innovation pace and diminishing returns, while emphasizing the need for better benchmarks and governance to manage these rapid advancements.

Will MacAskill, co-author of ‘Preparing for the Intelligence Explosion’ and AI safety expert, dives into the thrilling world of artificial general intelligence. He discusses the rapid advancements in AI and potential challenges for humanity as technology outpaces decision-making processes. The conversation touches on the societal implications of an intelligence explosion, including geopolitical tensions and existential risks. MacAskill also explores ethical considerations for AI governance and the impact of these technologies on our future, including in space exploration.

Join Rose Hadshar, co-author of ‘Intelsat as a Model for International AGI Governance’, as she delves into groundbreaking strategies for managing artificial general intelligence. She unveils how the Intelsat model can inform multilateral governance, addressing power concentration in tech. The conversation spans the evolution of satellite communication, historical parallels with AGI, and the dynamics of negotiation in international frameworks. Rose emphasizes the need for diverse representation to mitigate inequality and suggests practical lessons from satellite governance to shape the future of AGI.

This is a short trailer for ForeCast, the podcast from Forethought. Full episodes will appear in this feed.