Episode Summary
Executive Summary: The episode traces how early pandemic planning, based on lessons from 1918, showed that swift distancing can save lives—then contrasts that with COVID-era experts who used weak evidence to downplay risk and resist public health measures. It argues that expertise without humility, and certainty without solid data, can mislead the public and worsen outcomes.
Main Topics: 1918 influenza as a model for pandemic response (Priority: 5/5): Carter Mecher and Richard Hatchett reexamined city-by-city mortality data from the Spanish flu and found that cities acting earlier with non-pharmaceutical interventions (NPIs) had lower death rates. The Bush White House pandemic plan (Priority: 5/5): The doctors’ historical work informed the 2006 U.S. pandemic plan, emphasizing early distancing before a virus becomes visibly widespread. The Stanford antibody study and misleading certainty (Priority: 5/5): A Stanford seroprevalence study in Santa Clara County claimed widespread hidden infections and a very low fatality rate, but statistical criticism showed the test data were too unreliable to support strong conclusions. John Ioannidis, media amplification, and expert overreach (Priority: 5/5): Ioannidis, known for criticizing bad science, became a prominent public skeptic of COVID severity and used media platforms to make confident claims that later proved badly underestimates. Evidence from mortality and treatment improvements (Priority: 4/5): Hospital data from New York and later national/international comparisons showed COVID was highly lethal early on, while treatment improved over time as clinicians learned more. The danger of certainty in experts (Priority: 5/5): The episode argues that experts can become harmful when they seek attention, overstate confidence, or refuse to admit mistakes, while true expertise requires saying 'I don’t know.' Lessons for future public health response (Priority: 4/5): The final reflection is that the U.S. failed to learn from early mistakes, and future preparedness depends on humility, rapid learning, and trusting evidence over prominent voices.
Key Arguments: Early social distancing and other NPIs can materially reduce death during a pandemic because they buy time before vaccines or treatments exist. The 1918 influenza data, when examined carefully, showed that timing of interventions mattered more than city-by-city assumptions had suggested. The Stanford antibody study was too statistically fragile to justify the sweeping claims made from it; unreliable testing could not support a low fatality estimate. Ioannidis and Bhattacharya amplified uncertainty into public reassurance, helping normalize resistance to health measures at a critical moment. Public understanding was distorted because media favored confident, sensational voices over the more cautious majority of experts. COVID mortality was initially severe and real; later improvements in survival came from better medical knowledge, not because the virus was harmless. A recurring scientific failure is not just being wrong, but refusing to revise claims when better evidence arrives. The season’s central lesson is that humility—admitting uncertainty—is a mark of genuine expertise and a safeguard against public harm.
Data Points: Year of pandemic planning work: 2005-2006 - Carter Mecher and Richard Hatchett worked in the Bush White House on a national pandemic plan. 1918 mortality comparison: St. Louis death rate less than half of Philadelphia’s - City comparisons from the Spanish flu showed earlier interventions correlated with lower mortality. Shelter-in-place order date: March 16, 2020 - Santa Clara County issued the first U.S. shelter-in-place order. Santa Clara County antibody samples: 3,300 residents - Stanford researchers tested blood samples for COVID antibodies. Infection estimate from Stanford study: 50 to 85 times more infections than previously thought - The Stanford antibody results were initially interpreted as showing widespread hidden infection. Early COVID death count in Santa Clara County: 2 deaths - The low local death toll at the time made the Stanford study seem to imply low lethality. Forecast of U.S. deaths by Ioannidis: No more than 10,000 Americans - Ioannidis publicly claimed COVID deaths would remain limited. Revised forecast by Ioannidis: 40,000 American deaths - After the first wave in New York, he raised but did not fundamentally revise his public estimate. U.S. COVID death milestone by the episode’s framing: About 1 million Americans - The episode reflects on the broader toll accumulated over the pandemic. Hospital fatality rate in severe COVID cases: 25% in March 2020 - A severe COVID patient entering an American hospital in early March had a one-in-four chance of dying. Hospital fatality rate in severe COVID cases later: 5% three months later - Treatment improvements dramatically improved survival by mid-2020. New York City deaths in first month of wave: More than 10,000 - Jonathan Howard describes the scale of the first wave in New York. Global/US seroprevalence meta-analysis estimate: 0.5% to 1% fatality rate - A later meta-analysis of COVID lethality studies suggested a much higher death risk than Stanford’s early claims implied. U.S. deaths per million (July 1, 2021 to present in episode framing): 1,200 deaths per million - Used to compare the U.S. with other countries over later pandemic waves. U.K. deaths per million in same period: 600 deaths per million - The U.K. performed about twice as well as the U.S. in that period. Canada deaths per million in same period: 300 deaths per million - Canada’s mortality rate was about one-quarter of the U.S. rate. Japan deaths per million in same period: 100 deaths per million - Japan performed far better than the U.S. over the same period.
Pivotal Quotes: "How do you minimize disease and death? between the time a new virus starts to spread and the time we might have a vaccine for it." — Carter Mecher: Describing the core problem the Bush White House asked him to solve in pandemic planning. "It became very obvious to me that the evidence that we had in the early phases of the pandemic was utterly unreliable." — John Ioannidis: His April 2020 Fox News appearance defending his skepticism about COVID severity. "I think if anything, we probably have regressed." — Carter Mecher: His assessment that the U.S. has not learned the pandemic lessons needed for the next one.
Implications: The episode warns that high-status experts can amplify bad ideas when they trade humility for certainty. For public health, the lesson is to act early, question weak evidence, and reward people who admit uncertainty.
About Against the Rules
Michael Lewis’s best-selling book The Big Short is now 15 years old. The Oscar-winning movie based on it came out a decade ago. To mark the occasion, Lewis has narrated a new audiobook of The Big Short. Here on his podcast, he and co-host Lidia Jean Kott are thinking about the legacy of the book, the movie, and the financial crisis of 2008. Michael catches up with the director of the movie, Adam McKay, as well as some of the real-life characters depicted by the likes of Ryan Gosling, Steve Carell and Jeremy Strong. He also calls up journalists, economists, and historians to make sense of the 2008 financial crisis and to understand how it still affects the world today.