187 | Andrew Leigh on the Politics of Looming Disasters

Episode Summary

Executive Summary: Sean Carroll interviews Australian MP Andrew Leigh about existential risks—nuclear war, bioterrorism, AI, climate change, and natural catastrophes—and what politics can do about them. The conversation argues that these risks are real, underpriced, and politically neglected, requiring better institutions, more long-term thinking, stronger information defenses, and a stoic, bipartisan civic culture.

Main Topics: Sean Carroll’s job move and podcast framing (Priority: 5/5): Carroll opens with a major career announcement: he is moving from Caltech to Johns Hopkins, where his role will formally include philosophy, outreach, writing, and podcasting. He also notes the episode was recorded before the latest crisis, emphasizing that the topic of existential risk remains timely. Defining existential risk and the main threats (Priority: 5/5): Leigh defines existential risks as events that could end humanity or fundamentally alter its trajectory. He names nuclear war, bioterrorism, and misaligned AI as top concerns, while also discussing climate change, asteroids, supervolcanoes, and solar flares as additional risks. Probability, uncertainty, and long-term moral reasoning (Priority: 5/5): The discussion examines how to estimate low-probability, high-impact risks and whether the future should be discounted. Leigh argues against discounting future lives morally, treating presentism as a bias, while Carroll presses on uncertainty and the difficulty of translating moral concern into action. Climate change as a catastrophic collective-action problem (Priority: 4/5): They debate when climate change crosses from severe harm into existential catastrophe, including extreme warming scenarios and a Venus-like runaway greenhouse possibility. Leigh frames climate policy as a collective-action problem that requires common-pool solutions and better international coordination. Bioterrorism, lab safety, and information control (Priority: 5/5): Leigh argues that engineered pandemics may be more dangerous than natural ones because DNA synthesis is getting cheaper and biological knowledge is increasingly accessible. He supports stronger biosafety standards, tighter oversight of gain-of-function research, and limitations on publishing dangerous methods. AI risk and global governance (Priority: 5/5): Leigh says unaligned AI is the most worrying catastrophic risk because systems may resist shutdown, optimize the wrong goals, or behave in ways orthogonal to human values. He calls for guardrails before deployment, better coordination among states, and international standards to manage AI competition. Democracy, populism, and stoic politics (Priority: 4/5): The episode broadens from specific threats to political culture, arguing that populism worsens catastrophic risk by rewarding short-termism, conspiracy thinking, and institutional decay. Leigh advocates civic duty, democratic reform, and stoic virtues—prudence, moderation, courage, and justice—as the right response.

Key Arguments: Existential risk should mean not only extinction but also events that fundamentally derail human civilization; climate collapse, pandemics, or authoritarian breakdown can qualify. The scale of the future matters morally: future generations should count as fully as present ones, so protecting them is a serious obligation rather than optional altruism. Risk estimates are necessarily rough, but even back-of-the-envelope probabilities justify action when the stakes are enormous. Climate change is a classic collective-action problem, requiring coordination rather than purely individual action. Bioterrorism is especially dangerous because DNA synthesis and genetic engineering are becoming cheaper, faster, and easier to access. Publication norms in science may need to change when sharing findings meaningfully increases weaponization risk. AI risk is not just about intelligence but about systems gaining power, optimizing badly specified goals, resisting shutdown, and emerging from geopolitical competition. Populism worsens catastrophic risk by favoring short-term emotional mobilization over institutional stability and long-term planning. Democratic strengthening, civic participation, and stoic leadership are presented as political tools for reducing catastrophic-risk exposure.

Data Points: Estimated chance the human project ends in the next century: 1 in 6 - Andrew Leigh cites Toby Ord’s estimate as a summary of combined catastrophic risks. Climate warming risk estimate: 1 in 10 chance of 6°C rise; 1 in 100 chance of 10°C rise - Leigh uses these figures to explain why climate change may belong in the catastrophic-risk category. Natural-asteroid risk over the next 100 years: about 1 in 1,000,000 - Leigh contrasts asteroid risk with much higher anthropogenic risks. Engineered bioterrorism risk of knocking out the world’s population: 1 in 30 - Leigh gives this as a rough probability for a catastrophic engineered biological event. Median guess for AI surpassing human ability: 2061 - Leigh cites a recent survey of AI researchers. Biological Weapons Convention monitoring budget: smaller than a typical McDonald’s restaurant budget - Used to illustrate underinvestment in biosecurity oversight. Horsepox synthesis demonstration cost/time: about $100,000 in about 6 months - Example showing how feasible dangerous biological reconstruction can be. ProMed annual budget: $1 million per year - Leigh argues this is far too small for a major global disease-monitoring system. Climate Action Tracker assessment: only a handful of nations consistent with 2°C target; EU only coming close - Used to show global climate policy remains inadequate. Indigenous Australian vaccination disparity: lower than the overall Australian vaccination rate - Leigh cites misinformation as one cause of lagging uptake in Indigenous communities.

Pivotal Quotes: "I am a philosopher as well as a physicist, card-carrying right now, and all of the podcasts, writing books, giving talks kind of stuff, they want me to do that." — Sean Carroll: Opening announcement about his move from Caltech to Johns Hopkins and how his new role integrates outreach and philosophy. "I think of as things which would either end humanity or fundamentally alter the trajectory of the human project." — Andrew Leigh: Leigh’s definition of existential risk. "Let's get the guardrails in place before we build the highway." — Andrew Leigh: Argument for regulating AI before advanced systems are widely deployed.

Implications: Listeners are urged to treat existential risks as serious, improvable policy problems, not science fiction. The episode argues for stronger institutions, better scientific safeguards, and more long-term, less partisan civic thinking to reduce civilization-level danger.