ForeCast

Toby Ord, a Senior Researcher at Oxford University focused on existential risks, dives into the intriguing concept of the ‘scaling paradox’ in AI. He discusses how scaling challenges affect AI performance, particularly the diminishing returns of deep learning models. The conversation also touches on the ethical implications of AI governance and the importance of moratoria on advanced technologies. Moreover, Toby examines the shifting landscape of AI's capabilities and the potential risks for humanity, emphasizing the need for a balance between innovation and safety.

Lizka Vaintrob discusses ‘AI Tools for Existential Security’, co-authored with Owen Cotton-Barratt. To see all our published research, visit forethought.org/research.

Tom Davidson, co-author of the influential paper on AI R&D automation, delves into the potential for a software intelligence explosion. He discusses how automated AI research could lead to a runaway feedback loop, surpassing human capabilities. The conversation covers the Asara concept, suggesting AI might autonomously enhance research, revolutionizing the field. Davidson also highlights the balance between innovation pace and diminishing returns, while emphasizing the need for better benchmarks and governance to manage these rapid advancements.

Will MacAskill, co-author of ‘Preparing for the Intelligence Explosion’ and AI safety expert, dives into the thrilling world of artificial general intelligence. He discusses the rapid advancements in AI and potential challenges for humanity as technology outpaces decision-making processes. The conversation touches on the societal implications of an intelligence explosion, including geopolitical tensions and existential risks. MacAskill also explores ethical considerations for AI governance and the impact of these technologies on our future, including in space exploration.

Join Rose Hadshar, co-author of ‘Intelsat as a Model for International AGI Governance’, as she delves into groundbreaking strategies for managing artificial general intelligence. She unveils how the Intelsat model can inform multilateral governance, addressing power concentration in tech. The conversation spans the evolution of satellite communication, historical parallels with AGI, and the dynamics of negotiation in international frameworks. Rose emphasizes the need for diverse representation to mitigate inequality and suggests practical lessons from satellite governance to shape the future of AGI.

This is a short trailer for ForeCast, the podcast from Forethought. Full episodes will appear in this feed.