A History Of Existential Risk - Thomas Moynihan - #306

Episode Summary

Executive Summary: The discussion argues that existential risk is a modern intellectual breakthrough: humanity only recently began to understand its own extinction and the irreversible loss of its future. The guest traces how ideas about extinction evolved from ancient cyclical apocalypse stories to modern risk analysis, emphasizing that this awareness is both sobering and hopeful because it proves humans can correct mistaken beliefs and act to protect civilization's long-term potential.

Main Topics: Existential risk as a modern intellectual achievement (Priority: 5/5): The guest argues that simply recognizing extinction as a real, irreversible threat is a recent and profound advance in human knowledge, analogous to discovering perspective or rejecting slavery as natural. Why extinction is worse than catastrophe (Priority: 5/5): Using Parfit and Jonathan Schell, the conversation stresses the asymmetry between partial devastation and total extinction: extinction ends not just lives, but the entire future and all unrealized value. Historical development of the concept of extinction (Priority: 5/5): The guest traces the idea from pre-modern cyclical views, through Enlightenment-era fossils and species loss, to modern thinkers like Diderot, Holbach, Jefferson, Bostrom, and Ord. Technology as both threat and safeguard (Priority: 5/5): The interview frames technology as double-edged: it can create catastrophic risks like AI, pandemics, or nanotech, but also provides the only plausible defense against natural threats and long-run stagnation. Apocalypse vs. extinction (Priority: 4/5): Religious apocalypse is described as morally fulfilling and cyclical, whereas extinction is irreversible and frustrates ethics, meaning, and future value. They are presented as fundamentally different concepts. Longtermism, space colonization, and future potential (Priority: 4/5): The guest discusses astronomical future value, space expansion, and the opportunity cost of delay, arguing that humanity's future could be vastly larger and richer than the present if it survives. Hope, disillusion, and moral progress (Priority: 4/5): Despite the dark subject, the conversation frames existential-risk awareness as hopeful: humans are capable of correcting errors, reducing bias, and growing out of technological and moral adolescence.

Key Arguments: Recognizing existential risk is itself an achievement because it reflects humanity's ability to see beyond immediate threats and understand irreversible loss. Extinction is far worse than massive partial catastrophe because it forecloses the entire future of civilization and all possible value that might have emerged. Modern existential-risk thinking is historically new because pre-modern thinkers usually assumed nature, species, and value were cyclical and would return after catastrophe. Ancient and early modern discussions of cataclysm were not true extinction thinking because they assumed reversibility or re-emergence of life and civilization. The Enlightenment and later scientific revolutions slowly dismantled the 'principle of plenitude' and the assumption that nothing meaningful can be permanently lost. Technology must be pursued carefully because it is both the main source of engineered extinction risks and the main defense against natural existential threats. Ethics is lagging behind technology; our ability to build powerful systems has grown faster than our wisdom about how to use them safely. Long-termist thinking is justified because the future could contain far more beings, value, and complexity than the present, especially if humanity expands beyond Earth. Awareness of extinction can be hopeful rather than nihilistic because it reveals that humans can notice errors, change course, and protect their own future. Religious apocalypse should not be confused with extinction: apocalypse is a narrative of fulfillment, while extinction is the irreversible ending of sense, meaning, and moral agency.

Data Points: Species extinction rate: 99.9% - Used to emphasize that extinction is the norm in evolutionary history, not the exception. Habitability of Earth: ~1 billion years - Mentioned as the approximate remaining time Earth may stay habitable, implying a large future if civilization survives. Length of civilization: ~10,000 years - Used to argue that humanity is only at the beginning of its possible future. Toba supereruption date: ~75,000 years ago - Cited as a possible prehistoric bottleneck event that may have brought humanity close to collapse. Species extinct proportion: 99.9% of all species ever existed - Repeated to highlight how common extinction is across Earth’s history. Scientific/religious threshold: 1500s–1600s - Referenced as the period of the Scientific Revolution and changing cosmology. Enlightenment period: 1700s - Described as the era when fossils, extinction, and species loss became clearer in scientific thought. Long-termist/EA institutional era: Last 20–30 years - Described as the period of major progress in existential-risk theory via Parfit, Bostrom, Ord, and related institutions. Premodern extinction denial: Until late 1700s / Jefferson era - Thomas Jefferson was still arguing mammoths survived, illustrating how recent extinction acceptance is.

Pivotal Quotes: "extinction is the rule. Survival is the exception." — Thomas Moynihan: Used early in the discussion to set the evolutionary backdrop for why extinction deserves serious attention. "apocalypse supplies a sense of an ending, whereas extinction anticipates the ending of sense" — Thomas Moynihan: A central distinction in the interview between religious apocalypse and modern extinction thinking. "we're gods, we're just shitty gods" — Daniel Schmachtenberger (quoted by host): Used to capture the idea that human technological power now exceeds our moral wisdom.

Implications: The conversation suggests civilization must treat existential risk as a central policy and moral issue, not a niche philosophy topic. Understanding our precariousness should drive careful AI, biosecurity, and space-faring strategy while preserving hope in human self-correction.