The Hawthorne Effect

Episode Summary

Executive Summary: This episode examines the famous Hawthorne studies, showing how a once-celebrated workplace experiment on lighting and productivity became a scientific legend and then a methodological cautionary tale. Tim Harford recounts how John List and Steve Levitt recovered the original data and found the classic Hawthorne effect in the illumination study largely vanished after controlling for day-of-week productivity patterns. The episode also briefly addresses listener questions about left-handedness and fertility.

Main Topics: The Hawthorne studies and the rise of the Hawthorne effect (Priority: 5/5): A historical account of workplace experiments at the Hawthorne plant in 1920s Chicago that seemed to show workers became more productive whenever conditions changed, regardless of whether they improved or worsened. Workers respond to attention, not just working conditions (Priority: 5/5): The story emphasizes the interpretation that productivity gains came from being observed and treated as important, helping launch the human relations movement in management. Scientific reanalysis of the original data (Priority: 5/5): John List and Steve Levitt tracked down the long-lost data from the first illumination experiments and reexamined the evidence behind the famous claim. The Hawthorne effect as a caution for field experiments (Priority: 4/5): For social scientists, the case illustrates how experimenters can unintentionally alter behavior simply by being present, threatening the validity of workplace studies. Management implications of employee morale (Priority: 4/5): For managers, the studies reinforced the importance of communication, supervision, and treating employees as people rather than automatons. Listener follow-up on left-handedness and fertility (Priority: 2/5): The program answers a postbag question about why left-handers in the 19th century may have had fewer children, suggesting delayed marriage and stigma as possible explanations.

Key Arguments: The celebrated Hawthorne illumination result was based on qualitative claims rather than robustly presented data. When the original data were recovered, controlling for the fact that workers were more productive on Mondays made the apparent Hawthorne effect disappear. The original experiments were conducted on Sundays, which created a misleading comparison because workers were rested after their day off. Even if the original Hawthorne effect claim is weakened, later research still supports the broader idea that attention and observation can change behavior. The Hawthorne studies helped shift management thinking toward human relations, communication, and supervision. Left-handedness may have become less common historically because left-handed people may have married later and had fewer children, though the evidence is not definitive.

Data Points: Decade of the experiment: 1920s - The Hawthorne plant illumination studies took place in Chicago during the 1920s. Length of follow-up research: Nine years - Additional research after the initial lighting experiment continued for nearly a decade. Day of experimental change: Sunday - John List explains the changes were made on Sundays because workers had the day off. Workweek productivity pattern: Mondays highest, Saturdays lower - Recovered data showed workers were more productive at the start of the week and less productive by Saturday. Time period of left-handedness data: 19th century / late 1800s births - Chris McManus’s data on left-handed parents came from a survey of U.S. students born in the late 1800s.

Pivotal Quotes: "We could more logically attribute the increase in efficiency to a betterment of morale than to any of the alterations made in the course of the experiment." — Hawthorne study report: Summarizing the original interpretation of the productivity changes. "What we found was something astonishing." — John List: Introducing the discovery that the original data did not support the legendary Hawthorne effect once day-of-week behavior was considered. "after you control for just that people work harder on Mondays, the entire Hawthorne effect result disappears." — John List: Explaining the reanalysis that overturned the classic claim.

Implications: The episode warns listeners not to accept famous research stories uncritically and shows how hidden confounders can overturn accepted wisdom. It also reinforces that attention matters in workplaces, but not always for the reasons legends suggest.