Episode Summary
Executive Summary: The episode examines claims that a new systematic review found transgender women have no sporting advantage over cisgender women. It argues the evidence base is weak, often comparing unlike groups in small cross-sectional studies, and that “no statistically significant difference” should not be read as proof of equivalence. Both experts agree better-controlled, long-term studies in athletic populations are needed.
Main Topics: Why sex categories exist in sport (Priority: 5/5): The episode opens by explaining that men and women usually compete separately because average male physical advantages in size, strength, power, and endurance would make mixed competition unfair. What the systematic review actually did (Priority: 5/5): The paper did not run new experiments; it synthesized existing studies on transgender and cisgender women’s height, muscle, fitness, and strength to assess overall patterns. Problems with the underlying studies (Priority: 5/5): Many included studies were small, cross-sectional, and poorly matched, with major differences in training load, age, size, and competition level that confound comparisons. Misleading headlines and interpretation (Priority: 5/5): News headlines framed the paper as showing trans women have no advantage, but the segment emphasizes that the review only found no statistically significant differences in a weak evidence base. Longitudinal evidence and hormone therapy (Priority: 4/5): The discussion contrasts cross-sectional studies with the kind of long-term studies needed to track whether hormone therapy reduces strength and muscle enough to equalize competition. Author response and scientific caution (Priority: 4/5): One author argues the paper means the groups are not identical, only that current data did not show significant differences, while acknowledging stronger, longer-term studies would be more definitive.
Key Arguments: Sex-based competition rules exist because typical male physiological advantages in muscle mass, strength, height, and endurance are well established. The study was a systematic review, not a direct experimental comparison, so its conclusions depend on the quality of the included studies. Several included comparisons were not like-for-like; in one example, transgender women trained 4 hours a week versus 14 hours for cisgender women. Small sample sizes and unequal training volumes can easily distort observed differences in strength and fitness. Finding no statistically significant difference is not the same as proving equivalence or fairness in competition. The evidence is mostly cross-sectional, which is weak for judging change over time after hormone therapy. Longitudinal studies following transgender women before and after hormone treatment would be more informative, especially in trained athletes. The authors acknowledge the lack of ideal data, but argue their review suggests transgender women do not retain a typical male physiological profile after treatment.
Data Points: Training hours per week: Transgender women: 4; cisgender women: 14 - Brazilian volleyball study included in the review, highlighting an unfair comparison in training load Sample size: 7–8 people per comparison group - The Brazilian volleyball study was very small Statistical result: No statistically significant difference - Upper-body strength comparison across four studies in the review Evidence certainty: Very low - Researchers assessed confidence in the upper-body strength conclusion Study type: Systematic review - The paper synthesized prior studies rather than conducting new physical tests Duration of hormone treatment: 3 years - Longer-term hormone-treatment analysis lacked enough information for several strength/endurance measures
Pivotal Quotes: "Physical fitness of transgender and cisgender women is comparable, current evidence suggests." — Press release headline: Headline attached to the British Journal of Sports Medicine review "There wasn't a need for a systematic review of such poor evidence." — Professor Alan Williams: Critique of the weakness and heterogeneity of the studies included in the review "That interpretation is wrong. It's rather describing the fact that the analysis did not find statistically significant differences between the groups." — Bruno Gualano: Author response to claims that the paper proved trans and cis women are the same
Implications: Listeners should treat headline claims cautiously: weak, mixed studies cannot settle fairness in sport. The episode underscores the need for well-controlled longitudinal research in athletic populations before making policy decisions.
About More or Less Behind the Statistics
Tim Harford and the More or Less team try to make sense of the statistics which surround us. From BBC Radio 4