Episode Summary
Executive Summary: This episode of More or Less examines how weak evidence is often used in political and media claims, focusing on the Beecroft report on firing workers, Greek vs German work hours, government claims about “troubled families,” and cheating statistics. It argues that many headline claims are overstated, misframed, or unsupported, while emphasizing the need to compare claims against actual data.
Main Topics: Beecroft report and employment protection (Priority: 5/5): The programme tests claims that loosening UK employment law would boost growth and finds the report itself largely evidence-free, while OECD and academic evidence suggests UK employment protection is already light and macroeconomic effects are weak or absent. Greek vs German working hours (Priority: 5/5): It challenges the simplistic idea that Germans are “bailing out” lazy Greeks by showing Greeks work more hours per worker, but also notes differences in part-time work, self-employment, leave, and productivity that complicate the narrative. Troubled families funding and methodology (Priority: 4/5): A follow-up questions the government’s use of a 120,000-families estimate and the associated £9 billion cost claim, highlighting that the underlying data were not published and may reflect poverty more than troublesome behavior. Infidelity statistics and survey limits (Priority: 4/5): The show explores whether men cheat more than women, using survey data and methodological caveats about self-reporting, sensitive questions, and the distinction between infidelity and overlapping partnerships. Publication bias in science (Priority: 5/5): Ben Goldacre explains how positive findings are more likely to be published than negative ones, distorting medical and scientific literature and making evidence appear stronger than it really is. Editorial selection and statistical storytelling (Priority: 3/5): The programme reflects on the items it did not broadcast, underscoring that media outlets, including More or Less, tend to select more interesting results, which can skew public perception of evidence.
Key Arguments: The Beecroft pamphlet offers strong policy claims without citations or evidence, so its conclusions about labor-market flexibility are not well supported. OECD comparisons show the UK already has relatively light employment protection, so the country is not clearly burdened by excessive labor regulation. Most macroeconomic studies find no significant relationship between employment protection and unemployment, GDP per head, or growth. Some firm-level studies show small behavioral responses to thresholds in employment law, but these effects are too small to explain major economic outcomes. Greek workers average more hours than German workers, but differences in part-time employment, self-employment, holiday, sickness leave, and productivity alter the interpretation. The government’s troubled-families figures are methodologically shaky, and the funding allocation appears to rely on unpublished data with limited transparency. Reported infidelity rates depend heavily on survey design and self-reporting biases; measured concurrency may not equal direct “cheating” in all cases. Publication bias means that positive or surprising results are overrepresented in journals, inflating confidence in medical and scientific claims.
Data Points: Beecroft report length: 15 pages - Presenter criticizes the report as too short to be a substantive evidence-based review. UK employment protection comparison: Only the US has lighter protection for regular employment - OECD comparison of employment protection legislation. UK temporary worker regulation comparison: Only Canada, the US and the Slovak Republic are lighter - OECD comparison for temporary workers. Greek working hours: More than 2,000 hours per year - Average Greek worker hours in OECD data. German working hours: About 1,400 hours per year - Average German worker hours in OECD data. Greek hours vs German hours: About 40% longer - Headline comparison before adjustments for part-time and self-employment. Part-time employment in Germany: More than one in four - Explains why German average hours per worker are lower. Full-time salaried worker gap after adjustments: Greeks still work almost 10% more hours - After removing part-time and self-employed workers. Employment rate: 60% in Greece vs 72% in Germany - Hours per adult working-age citizen discussion. Troubled families budget: £448 million over three years - Allocated to local authorities under the Troubled Families Programme. Troubled families estimate: 120,000 families - Government’s figure later questioned as reflecting poverty rather than troublesome behavior. Estimated annual cost: £9 billion - Government’s claimed cost of troubled families to the nation. Concurrent partnerships in last year: 15% of men vs 9% of women - Natsal survey measure used as a proxy for overlapping sexual relationships. General Social Survey sample: 20,000 people - 2006 US survey cited for infidelity self-reports. Publication rate of trials: About half of conducted trials are published - Ben Goldacre’s explanation of publication bias. Publication advantage for positive trials: About twice as likely to be published - Positive results compared with negative ones.
Pivotal Quotes: "The conclusion of the vast majority of the studies is that there is actually no significant relationship between employment protection and the overall level of unemployment." — John Van Rienen: Summarizing the academic evidence on labor regulation and unemployment. "No, in comparison with OECD countries, employment protection legislation in the UK is fairly light." — Christophe André: OECD assessment of the UK labor-market regulatory environment. "Publication bias is the phenomenon whereby positive, exciting, interesting findings are much more likely to get published in academic journals than boring, negative findings." — Ben Goldacre: Definition of publication bias and why it distorts the evidence base.
Implications: Listeners should be skeptical of bold policy or social claims without transparent evidence. The episode shows why methodology matters, how selective reporting distorts debate, and why policymakers and media should distinguish headline narratives from measurable reality.
About More or Less Behind the Statistics
Tim Harford and the More or Less team try to make sense of the statistics which surround us. From BBC Radio 4