Plain English with Derek Thompson
Plain English with Derek Thompson

Why There Is So Much Bullsh*t in Science

We should be living in a golden age of creativity in science and technology. We know more about the universe and ourselves than we did in any other period in history, and with easy access to superior research tools, our pace of discovery should be accelerating. But as one group of researchers from S

Topics Discussed

Episode Summary

Executive Summary: The episode examines evidence that scientific and technological progress is slowing across fields, despite more researchers, funding, and knowledge than ever. Using Russell Funk’s work on the CD index, the discussion explores why papers and patents are becoming less disruptive, highlighting burden of knowledge, information overload, academic incentives, and the rise of big-team science as likely contributors.

Main Topics: Measuring the slowdown in scientific progress (Priority: 5/5): Funk explains how researchers infer declining progress indirectly through Nobel timing, citation age, recombination patterns, and the CD index, since breakthroughs are hard to compare directly across fields. The CD index and disruption (Priority: 5/5): The conversation centers on the study 'Papers and Patents Are Becoming Less Disruptive Over Time,' which finds that newer papers are less likely to displace prior work and are more consolidating than disruptive. Burden of knowledge and specialization (Priority: 5/5): One major explanation is that science has become harder to do because the body of required knowledge has exploded, pushing researchers toward narrow specialization and later-career contributions. Paradox of choice and filter bubbles (Priority: 4/5): Even as the supply of papers, tools, and ideas grows, researchers may become overwhelmed and rely on a smaller set of familiar, highly cited works, reinforcing intellectual clustering. Academic incentives and the 'publish or perish' system (Priority: 5/5): The incentive structure of academia rewards publication counts, citations, and top-journal placement, which can favor safer, more familiar, and less disruptive work over bold breakthroughs. Big science versus small science (Priority: 4/5): Science now often requires large, coordinated teams for complex problems, but larger teams tend to produce more developmental work while smaller teams are more likely to generate disruptive ideas. Low-hanging fruit and future possibilities (Priority: 4/5): The discussion considers whether easy discoveries have been exhausted, but Funk argues the evidence suggests broader social and organizational factors matter more. Artificial intelligence and new methods may help reverse the trend.

Key Arguments: Scientific progress matters because it underpins health, technology, education, and long-run economic growth. The decline in progress can be measured indirectly through delayed Nobel recognition, older citations, and lower disruption scores in papers and patents. The CD index suggests that modern papers and patents increasingly build on, rather than replace, existing knowledge. The burden of knowledge forces greater specialization, making it harder for researchers to access and recombine diverse ideas. A growing volume of research and digital search tools can create information overload, causing researchers to cluster around a narrow set of canonical works. Academic incentives reward measurable outputs such as publications and citations, which can discourage high-risk, high-disruption research. Large, bureaucratic science teams are often necessary for modern big problems, but they can favor incremental work over disruptive ideas. The slowdown is likely multi-causal rather than driven by a single factor, and may be partly reversible with new tools like AI and better institutional design.

Data Points: Nobel Prize timing gap: 20, 30, 40 years - Funk notes that Nobel Prizes are increasingly awarded decades after the original discovery, suggesting older breakthroughs dominate recognition. Scientific knowledge decline: since the early 1970s - The host references a paper concluding that scientific knowledge has been in secular decline since this period. Data cutoff in the study: 2010 - Funk says the paper’s dataset ran through 2010, with some later evidence examined separately. Moore’s Law expectation: doubles every two years - Used as an example of a once-strong progress law that appears to be slowing. Postdoctoral length: 2–3 postdocs - The conversation uses this as evidence that entering the frontier now takes much longer than in earlier scientific eras. Large Hadron Collider scale: $10 billion - Illustrates how much more infrastructure can be required for modern breakthroughs compared with earlier physics discoveries. Historical field comparison year: 1945 - The study begins around this time to compare decline patterns across disciplines.

Pivotal Quotes: "everywhere we look, we find that ideas are getting harder to find." — Speaker referring to Stanford researchers: Used to frame the broader concern that idea generation is becoming more difficult across science. "The burden of knowledge essentially says there's so much knowledge that people have to learn before they enter into a domain ... that it becomes harder to push forward the frontier." — Russell Funk: Defines one of the main hypotheses for why scientific progress is slowing. "lots of combinations aren't valuable." — Russell Funk: A caution that recombination drives innovation, but not every mix of old and new ideas produces a breakthrough.

Implications: If the trend continues, science may produce fewer transformative discoveries, slowing technological and economic progress. Reforming incentives, supporting smaller teams, and using new tools like AI could help restore disruption.

🔓 Sign Up for Unlimited Episode Search

About Plain English with Derek Thompson

View all episodes from Plain English with Derek Thompson