Some of America's Most Important Economic Data Is Decaying

Episode Summary

Executive Summary: The episode examines how U.S. economic statistics are produced, why they are getting harder and more expensive to collect, and what is at risk as response rates fall. Former BLS commissioner Bill Beach explains the mechanics of jobs, inflation, and labor-force surveys, argues that the household survey is in serious decline, and calls for modernization through digital collection and blended data sources.

Main Topics: How the jobs report is assembled (Priority: 5/5): Bill Beach walks through the establishment and household surveys behind the monthly jobs report, including timing, sampling, weighting, and the secrecy protocol before release. Rising costs and falling response rates (Priority: 5/5): The conversation centers on how inflation, wages, and lower public cooperation are making survey collection more expensive and less reliable, especially for household-based labor data. Modernization of federal statistics (Priority: 5/5): Beach argues BLS must move toward electronic, internet-based, and blended public-private data systems to keep official statistics viable. Data quality, revisions, and public trust (Priority: 4/5): The hosts and Beach discuss why revisions happen, why people mistrust government data, and how BLS tries to explain methodology transparently. Quality adjustment and the measurement of inflation (Priority: 4/5): The episode explores how BLS adjusts for product changes such as improved refrigerators or shrinking snack sizes so inflation measures reflect quality, not just sticker price. Risks to granularity and demographic detail (Priority: 4/5): Beach warns that shrinking samples will reduce the ability to publish detailed statistics for smaller age, regional, and demographic groups.

Key Arguments: Official statistics are not simple outputs; they require complex sampling, weighting, fieldwork, and timing to produce each release. The current population survey and other BLS surveys are under pressure from declining response rates and rising labor costs, making the system fragile. The household survey is especially vulnerable because it depends on live interviewers and no alternative data source fully replicates its labor-force measures. Modernization should combine internet-based collection, private-sector data, and traditional survey methods rather than relying solely on legacy field surveys. Response-rate declines are not just a U.S. issue; similar problems are affecting statistical agencies in the U.K. and elsewhere. BLS revisions are often the result of late responses and benchmark comparisons, not manipulation, and transparency helps build trust. Quality adjustments are necessary to avoid overstating inflation when products change in ways that are not obvious from prices alone.

Data Points: Establishment survey sample: about 400,000 firms - Used for the payroll portion of the monthly jobs report out of 11.3 million U.S. firms Total U.S. firms: 11.3 million - Population from which the jobs survey sample is drawn Household survey sample: 60,000 households - Used to calculate unemployment and labor-force statistics BLS headquarters staff involved in data processing: about 40 people - Small group that massages sampled survey data into national estimates BLS total staff: about 2,000 people - Agency-wide workforce mentioned by Beach Survey collection time: about 30 minutes - Time needed to complete the establishment survey response Household survey questions: over 120 questions - Illustrates the burden and complexity of the CPS interview Housing portion of CPI response rate: about 70% in 2015 to 57% now - Shows declining response quality over time JOLTS response rate: about 67% to 30% - Example of a major fall in survey participation CPS sample reduction: 5,000 households - Announced reduction to preserve publishability of the remaining sample Additional annual funding need by 2023: almost $4 million to $5 million more - Beach says this was needed to maintain the household survey Funding increase in continuing resolution: $6 million more - Recent congressional boost to help fill the wage-bill gap Jobs benchmark revision example: 818,000 preliminary estimate of a decrease in employment - Used to explain why revisions can look dramatic when benchmarked to the full universe BLS price revision window: up to four months after publication - Mentioned in relation to PPI revisions and late responses CPI item count: 200 plus items - BLS field staff are trained to evaluate changes across many basket items

Pivotal Quotes: "Our surveys, but especially the current population survey, the one that gives us the unemployment rate, the labor force data, are dying, they're decaying, they're in very serious trouble." — Bill Beach: Beach’s central warning about the fragility of labor statistics "It's not just a U.S. problem. Right. Like there's no U.S. exceptionalism here." — Tracy Alloway: Opening discussion of declining response rates and data quality problems abroad "We have to approach this like we might approach roads and bridges" — Bill Beach: Beach’s analogy for treating statistical infrastructure as public infrastructure requiring investment

Implications: Listeners should see official data as costly public infrastructure, not an automatic byproduct of government. If funding, response rates, and modernization lag, labor and inflation statistics may lose detail, revise more, and become less reliable.