342: History of Data Science - Part 2

Episode Summary

Executive Summary: The episode traces how data science evolved in the 2001–2010 period from a largely anticipated idea into a recognized and rapidly growing field. It highlights foundational contributions from statisticians and computer scientists, new journals and formal definitions, and the surge of attention around 2008–2009 that set up the modern data science boom.

Main Topics: Data science vs. science fiction expectations: The episode contrasts early 2000s reality with futuristic expectations of AI, noting that sentient machine intelligence like HAL 9000 had not arrived. Call for a new hybrid profession: William Cleveland advocated for a profession merging data analysis and computer science, foreshadowing the modern data scientist role. Statistical and algorithmic shift: Leo Breiman argued for algorithmic models over traditional stochastic data models, aligning with machine learning approaches used today. Institutional recognition and formalization: The launch of major journals and a National Science Board definition helped legitimize data science as a distinct and valuable discipline. Global research expansion: China established an early data science research center and researchers argued data science was a new science centered on data in cyberspace. The 2008–2009 boom: By 2008–2009, articles and commentary from major figures framed data science as essential, popular, and foundational to future science and society.

Key Arguments: Data science did not become the fully sentient AI imagined by science fiction, but it did mature into a serious scientific and professional field. William Cleveland’s call for a merged analyst-computer-scientist profession anticipated the interdisciplinary nature of modern data science. Leo Breiman’s advocacy for algorithmic modeling helped shift practice toward machine learning methods that are now standard. The creation of journals and official definitions in the 2000s formalized data science as a legitimate discipline. The bottleneck in the data-rich era was no longer data access but the ability to understand and extract insight from data. By the end of the decade, data science had become widely recognized as central to science, business, and the economy.

Data Points: Time period covered: 2001–2010 - The episode focuses on the first decade of the 21st century in the history of data science. Number of journals launched: 2 - The Data Science Journal and the Journal of Data Science were launched in the early 2000s. Year of National Science Board definition: 2005 - The board defined data scientists as those whose primary activity is creative inquiry and analysis. Year of first data science research center in China: 2007 - A research center was established in Shanghai. Year researchers argued data science is a completely new science: 2009 - Shanghai researchers described data science as distinct because its object is data in cyberspace. Year identified as the start of the big boom: 2008 - The episode marks 2008 as the point when data science began to surge in visibility and recognition. US chief data scientist tenure mentioned: 2015–2017 - DJ Patil is noted as the chief data scientist of the United States during these years. Video view count: over 2 million views - A YouTube video about HAL 9000 is mentioned as a reference to AI expectations.

Pivotal Quotes: "Data Scientist is the Sexiest Job of the 21st Century" — DJ Patil and Tom Davenport: Title of the Harvard Business Review article credited with popularizing data science in the public imagination. "Those whose primary activity is to conduct creative inquiry and analysis" — National Science Board: Formal 2005 definition of data scientists. "the bottleneck is the ability to understand that data and gain insight from it" — Google’s chief economist: Explains why analytics and interpretation became more important as data availability grew.

Implications: The 2000s transformed data science from an emerging idea into a recognized profession and research field. For listeners, this explains why modern data science is interdisciplinary, model-driven, and increasingly central to business and science.