John A. List: Improving the World with Economics (EP.204)

Episode Summary

Executive Summary: Ben Felix and Cameron Passmore interview economist John List about why field experiments matter, how they uncover causal effects, and why scaling ideas is harder than finding them. List connects behavioral economics, replication, marginal thinking, and critical thinking to investing, charity, and public policy, emphasizing that good ideas often fail because they’re not tested under real-world constraints.

Main Topics: Field experiments as causal evidence (Priority: 5/5): List explains that the real world can serve as a laboratory, allowing researchers to isolate causal relationships far better than observational data alone. Scaling and the 'voltage effect' (Priority: 5/5): The conversation centers on why ideas that work in small tests often lose power at scale, and how to judge whether an idea can expand successfully. Investing, loss aversion, and portfolio behavior (Priority: 5/5): List applies behavioral findings to personal finance, arguing that frequent portfolio checking increases loss aversion and harms long-term returns. Charitable giving and donor motivation (Priority: 4/5): He discusses what drives donations, how men and women may respond differently to incentives, and why donors should demand measurable impact. Critical thinking and education (Priority: 4/5): List argues critical thinking is the most transferable human skill and should be taught more directly rather than relying on memorization. Marginal thinking, quitting, and opportunity cost (Priority: 4/5): He shows how decisions improve when people focus on the incremental effect of new choices and recognize the value of changing course. Policy, technology, and data at scale (Priority: 4/5): List argues that technology improves data collection and experimentation, but policy still needs better 'data refineries' and scaling units.

Key Arguments: Field experiments are essential because they allow economists to make causal statements in messy real-world environments, not just correlations. A higher matching grant increases charitable giving versus no match, but the exact match ratio often does not matter much; framing can be more important than the dollar amount. Economic theory can be experimentally tested even when it seems hard to observe directly, such as supply and demand, discrimination, and price elasticity. Results often generalize more reliably across people than across situations; context such as substitutes, income, and constraints can materially change outcomes. People should check investment portfolios as rarely as possible because myopic loss aversion leads them to sell risky assets after short-term losses. Men and women were equally risk-averse in one mutual fund dataset once differences in education and investment knowledge were controlled for. In his risk experiments in a matrilineal Indian society, socialization appeared to reverse typical gender patterns in risk-taking and bargaining. Replications are underemphasized in academia, and publication bias plus the file-drawer problem distort what the literature appears to show. Charitable giving is often driven by warm glow, social pressure, prestige, and tax incentives; altruism matters, but not as much as many assume. Donors should evaluate charities by outcomes and scalability, not by intention alone; organizations should show that money produces measurable impact. The voltage effect is about whether an idea that works in a small, controlled setting still works when scaled into the real world. Big societal problems like poverty, climate change, and public health are hard because scientists often test efficacy in the 'petri dish' rather than real-world scaling conditions. Critical thinking requires slowing down, checking evidence sources, and separating causal reasoning from bias, heuristics, and groupthink. Marginal thinking beats averages for decisions like marketing spend, because the most recent units often reveal where resources should actually go. Winners should sometimes quit or pivot when opportunity costs improve; staying in place out of principle can be irrational. Technology and AI can improve scaling by reducing labor constraints and helping firms and governments analyze more data, but humans still need to define the right questions.

Data Points: Academic publications: ~250 - List says he has roughly 250 academic publications. Value of time: About $19 per hour - Estimated from Uber/Lyft experiments on price and ETA tradeoffs. Local wage rule for public projects: About one-half to three-quarters of local wage - Typical federal approach to valuing time savings in benefit-cost analysis. Loss aversion ratio: $1 of gain ≈ $1.56 of loss - List describes losses as felt about 56% more than comparable gains. Charitable giving concentration: 40% of U.S. charitable gifts from 1% of people - Used to illustrate skewed giving behavior. Top wage earners' share of charitable dollars: 13% - Top 1,000 wage earners in the U.S. give 13% of charitable dollar gifts. Driver acquisition example: $300 vs $400 per driver - Average cost across last 1,000 drivers on Facebook ads vs Google ads. Marginal driver acquisition example: $1,000 vs $500 per driver - Cost of the last 25 drivers on Facebook ads vs Google ads, reversing the average-based decision. CFL adoption: 70% of households in a neighborhood - Social-nudge example used to encourage the first energy-efficient bulb adoption. Walmart workforce: 2.3 million workers - List cites Walmart’s scale as part of the appeal of his new role. U.S. proximity to Walmart: 90% of people live within 10 miles - Illustrates Walmart’s reach and potential scale. Replication significance level: 5% alpha - List references conventional statistical significance and false positives.

Pivotal Quotes: "Critical thinking is the world's ultimate renewable resource." — Benjamin Felix: He highlights John List’s framing of critical thinking as the key transferable skill from the interview. "As rarely as possible." — John List: His answer to how often investors should look at their portfolios. "If I reach my production frontier every day, that's a success." — John List: He defines success as maximizing controllable inputs rather than chasing outcomes.

Implications: Listeners should favor experiments, replication, and marginal analysis over intuition. For investors and donors, the lesson is to focus on long-term outcomes, real-world scalability, and avoiding bias-driven decisions.