In this book, Toby Ord argues that humanity is in a uniquely dangerous period, which he terms 'the Precipice,' beginning with the first atomic bomb test in 1945. Ord examines various existential risks, including natural and anthropogenic threats, and estimates that there is a one in six chance of humanity suffering an existential catastrophe within the next 100 years. He advocates for a major reorientation in how we see the world and our role in it, emphasizing the need for collective action to minimize these risks and ensure a safe future for humanity. The book integrates insights from multiple disciplines, including physics, biology, earth science, computer science, history, anthropology, statistics, international relations, and moral philosophy[1][3][5].
"Suppose we make these grants, we do some of those experiments I talk about. We discover, for example — I’m just making this up — but we give people superforecasting tests when they’re doing peer review, and we find that you can identify people who are super good at picking science. And then we have this much better targeted science, and we’re making progress at a 10% faster rate than we normally would have. Over time, that aggregates up, and maybe after 10 years, we’re a year ahead of where we would have been if we hadn’t done this kind of stuff.
"Now, suppose in 10 years we’re going to discover a cheap new genetic engineering technology that anyone can use in the world if they order the right parts off of Amazon. That could be great, but could also allow bad actors to genetically engineer pandemics and basically try to do terrible things with this technology. And if we’ve brought that forward, and that happens at year nine instead of year 10 because of some of these interventions we did, now we start to think that if that’s really bad, if these people using this technology causes huge problems for humanity, it begins to sort of wash out the benefits of getting the science a little bit faster." —Matt Clancy
In today’s episode, host Luisa Rodriguez speaks to Matt Clancy — who oversees Open Philanthropy’s Innovation Policy programme — about his recent work modelling the risks and benefits of the increasing speed of scientific progress.
Links to learn more, highlights, and full transcript.
They cover:
- Whether scientific progress is actually net positive for humanity.
- Scenarios where accelerating science could lead to existential risks, such as advanced biotechnology being used by bad actors.
- Why Matt thinks metascience research and targeted funding could improve the scientific process and better incentivise outcomes that are good for humanity.
- Whether Matt trusts domain experts or superforecasters more when estimating how the future will turn out.
- Why Matt is sceptical that AGI could really cause explosive economic growth.
- And much more.
Chapters:
- Is scientific progress net positive for humanity? (00:03:00)
- The time of biological perils (00:17:50)
- Modelling the benefits of science (00:25:48)
- Income and health gains from scientific progress (00:32:49)
- Discount rates (00:42:14)
- How big are the returns to science? (00:51:08)
- Forecasting global catastrophic biological risks from scientific progress (01:05:20)
- What’s the value of scientific progress, given the risks? (01:15:09)
- Factoring in extinction risk (01:21:56)
- How science could reduce extinction risk (01:30:18)
- Are we already too late to delay the time of perils? (01:42:38)
- Domain experts vs superforecasters (01:46:03)
- What Open Philanthropy’s Innovation Policy programme settled on (01:53:47)
- Explosive economic growth (02:06:28)
- Matt’s favourite thought experiment (02:34:57)
Producer and editor: Keiran Harris
Audio engineering lead: Ben Cordell
Technical editing: Simon Monsour, Milo McGuire, and Dominic Armstrong
Additional content editing: Katy Moore and Luisa Rodriguez
Transcriptions: Katy Moore
80,000 Hours Podcast 
