80,000 Hours Podcast
80,000 Hours Podcast

#72 - Toby Ord on the precipice and humanity's potential futures

This week Oxford academic and 80,000 Hours trustee Dr Toby Ord released his new book The Precipice: Existential Risk and the Future of Humanity. It's about how our long-term future could be better than almost anyone believes, but also how humanity's recklessness is putting that future at g

Featured Speakers

The 80,000 Hours team HostToby Ord Guest

Topics Discussed

Episode Summary

Executive Summary: The episode features Toby Ord discussing The Precipice, arguing that humanity is in a rare "precarious" era where technological power creates serious existential risks. He walks through major threats—asteroids, supervolcanoes, climate change, pandemics, nuclear war, and AI—explaining why some are lower than commonly feared and others, especially engineered pandemics and unaligned AI, are highly concerning. The conversation closes on long-term future, policy, and moral responsibility.

Main Topics: The Precipice and existential risk: Ord explains his core thesis: humanity’s growing power creates the possibility of destroying not only lives now but the entire future of human potential. This is the central framing of the book and the interview. Natural risks: asteroids, comets, supervolcanoes, and space threats: The discussion details why natural extinction risks are generally lower than many expect, while still non-trivial. Asteroid deflection is harder for extinction-scale objects than for smaller local-catastrophe threats, and supervolcanoes remain poorly understood and difficult to forecast. Climate change as a possible existential risk factor: Ord revises his view upward on climate risk, stressing uncertainty in climate sensitivity, extreme warming tails, and hard-to-model feedbacks. He sees climate change more as a risk factor and possible civilization stressor than a clear direct extinction mechanism. Biological threats and engineered pandemics: The episode contrasts natural pandemics with engineered ones, arguing that the latter are much more dangerous because intent, scale, and democratized biotech massively raise the chance of catastrophic misuse or accidental release. Nuclear war and civilizational collapse: Ord gives a lower extinction estimate for nuclear war than many listeners might expect, while still treating it as a serious existential threat because of nuclear winter, collapse, and uncertain recovery pathways. AI alignment and the biggest risk: Unaligned AI is presented as the highest modeled risk because it may surpass human intelligence, scale through manipulation and digital systems, and then permanently displace human control over the future. Long-term future, priors, and what should be done: The interview closes with debate over whether this is a particularly important time in history, how to reason under deep uncertainty, and how to build a good future through research, governance, policy, and public conversation.

Key Arguments: Humanity is in a "precipice" period because technological capability has outpaced wisdom, making self-destruction plausible for the first time in history. Natural risks are constrained by our 2,000-century survival record; this makes very high estimates for asteroids, supervolcanoes, and similar natural threats hard to defend. Asteroid risk is real but limited: the largest extinction-class asteroids are few, well cataloged, and current deflection methods are not designed for the largest threat class. Climate change may not be a straightforward extinction threat, but uncertainty about extreme feedbacks, sensitivity, and out-of-model effects leaves a non-negligible tail risk. Engineered pandemics are much more dangerous than natural pandemics because biotechnology is becoming democratized and malicious or reckless actors can intentionally optimize for harm. Nuclear war is worrisome primarily through nuclear winter and second-order collapse mechanisms, but current evidence suggests extinction is less likely than many assume. AI risk is high because creating systems smarter than humans could remove humanity from control of the future; the concern is loss of control, not necessarily immediate extinction. The most important uncertainties are the tails: extreme climate outcomes, unknown bio risks, unknown technological pathways, and whether civilization can recover after collapse. Existential risk reduction remains valuable regardless of whether overall risk is high or low: if risk is low, the future is longer; if risk is high, there is more to reduce. A good future may require a long reflective period where humanity deliberately decides how to use its power before permanently locking in values or institutions.

Data Points: Book publication date (UK): March 5 - Announced at the start of the episode for The Precipice. Book publication date (US / audiobook): March 24 - The US and audiobook editions were said to release later in March. Humanity’s current age: 2,000 centuries - Ord frames the argument around humanity having existed for about 200,000 years. Asteroid extinction risk in next 100 years: 1 in 1,000,000 - Ord’s estimate for asteroid/comet impact causing extinction within the century. Supervolcanic eruption extinction risk in next 100 years: 1 in 10,000 - Ord’s estimate for existential risk from supervolcanoes. Stellar explosion risk in next 100 years: 1 in 1,000,000,000 - Ord’s estimate for supernovae or related stellar explosions. Nuclear war extinction risk in next 100 years: 1 in 1,000 - Ord’s estimate for nuclear war causing existential catastrophe. Climate change extinction risk in next 100 years: 1 in 1,000 - Ord’s best guess for existential risk from climate change. Natural pandemics extinction risk in next 100 years: 1 in 10,000 - Ord’s estimate for natural pandemics causing extinction. Engineered pandemics extinction risk in next 100 years: 1 in 30 - Ord’s estimate for engineered pandemics causing extinction. Unaligned AI extinction / existential risk in next 100 years: 1 in 10 - Ord’s estimate for AI causing an existential catastrophe. Total existential risk in next 100 years: 1 in 6 - Ord’s headline combined estimate for humanity failing to make it through the century with potential intact. Business-as-usual existential risk in next 100 years: 1 in 3 - Ord says the risk would be higher if humanity continues mostly ignoring these risks. Probability AGI is developed this century: ~50% - Ord cites both expert and public expectations around AGI timing. Climate sensitivity range: 1.5°C to 4.5°C - Warming from doubling CO2, with large uncertainty emphasized. Potential warming if emissions and sensitivity are high: 1.5°C to 9°C - Ord combines emission and climate sensitivity uncertainty to show wide tail outcomes. Temperature increase from burning all fossil fuels / similar carbon stores: 9°C to 13°C - Referenced as an analog for very large carbon release, including methane clathrates. Years since 1960 confirmation of impact craters: 1960 - Modern scientific confirmation that asteroids cause impact craters. Years since 1980 Alvarez hypothesis: 1980 - The theory that an asteroid killed the dinosaurs became prominent then. Supervolcano threshold: >1,000 cubic kilometers of erupted material - Definition used in the discussion of supervolcanic eruptions. Estimated number of >10 km near-Earth asteroids: 4 - Ord says astronomers think there are four such objects and have found them all. Estimated number of 1-10 km near-Earth asteroids: ~920 - Ord says about 920 exist and ~95% have been found. Estimated size of current BWC budget: About the cost of an average McDonald’s restaurant - Used to illustrate how underfunded the Biological Weapons Convention is. US / Russian strategic nuclear treaties discussed: New START and INF - Ord suggests renewing or strengthening these treaties. Risk factor contribution of climate change: 0.1% to 1% - Ord estimates climate change mostly as a risk factor rather than direct existential risk.

Pivotal Quotes: "the destruction not only of the present, but of the entire future and everything that we could hope to achieve" — Toby Ord: Explaining why existential risk matters beyond immediate harms. "I call this time the precipice" — Toby Ord: Defining the era in which humanity’s technological power may outstrip its wisdom. "if the risk is low, then that suggests that the lifetime of humanity, if we manage to get through this century, is going to be very long" — Toby Ord: Describing why existential risk reduction matters whether current risk is high or low.

Implications: The episode argues for serious investment in existential-risk research, biosecurity, AI alignment, climate-tail-risk analysis, and public policy. For listeners, the message is to think long-term, fund neglected prevention work, and help build institutions capable of steering humanity safely through a dangerous transition.

🔓 Sign Up for Unlimited Episode Search

About 80,000 Hours Podcast

View all episodes from 80,000 Hours Podcast