Rethinking Investing with Greenwich Associates' Charles Ellis

Episode Summary

Executive Summary: Barry Ritholtz interviews investing legend Charlie Ellis about how markets have changed since the 1960s and why low-cost indexing has become the most reliable strategy for most investors. Ellis argues that increased information access, regulation, computing power, and investor skill have made active outperformance far harder, while human biases and fees further erode returns. He also emphasizes compounding, long horizons, and portfolio design that accounts for Social Security and housing wealth.

Main Topics: The transformation of investing since the 1960s (Priority: 5/5): Ellis explains how the investment world shifted from sparse data, limited research, and slower markets to a highly competitive, information-rich environment with powerful computing and instant access to facts. Why active management is harder to justify (Priority: 5/5): He argues that as markets became more efficient and participants more skilled, it became increasingly difficult for active managers to beat the market after fees, taxes, and mistakes. Behavioral mistakes and the case for indexing (Priority: 5/5): Ellis stresses that investors regularly make emotional errors—buying high, selling low, overestimating skill—and says index funds help by being boring and reducing intervention. Compounding and long-term investing (Priority: 4/5): A major theme is the power of time and compounding over decades; Ellis frames indexing as a way to stay invested long enough to capture repeated growth. Total portfolio thinking (Priority: 4/5): He urges investors to include Social Security and home equity in their overall financial picture, which can justify a more equity-heavy securities portfolio than many expect. Revisiting the meaning of 'passive' (Priority: 3/5): Ellis rejects the term passive as misleading and negative, preferring 'indexing' because the strategy is deliberate, disciplined, and cost-aware rather than inactive.

Key Arguments: Markets are now more efficient because information, regulation, and computing power have dramatically improved, making it harder for any active manager to gain an edge. The 'paradox of skill' means that when all participants are highly capable, outcomes depend more on luck and small errors. Fees, taxes, and behavioral mistakes create a persistent drag that often overwhelms the benefits of active stock picking. Index funds and ETFs reduce the temptation to tinker, helping investors avoid costly emotional decisions. Over long periods, broad-market indexing has outperformed most professionally managed stock funds. Investors should evaluate their total economic resources—including Social Security and home equity—before deciding on asset allocation. Time is one of the most important advantages an investor can have, because compounding rewards patience and early saving.

Data Points: Rockefeller investment-office tenure: 2.5 years - Ellis worked at the Rockefeller family office before moving to Wall Street. Trading volume on NYSE-listed stocks in the early era: 3 million shares - Ellis compares historical trading volume with today’s vastly larger volume. Current NYSE-listed trading volume: 6–8 billion shares - Used to illustrate the scale change in market activity over time. Average active-investor error cost: about 2% per year - Ellis cites research suggesting investors lose roughly 2 percentage points annually through mistakes. UC Davis study market return: 17.9% annually - Return on the market over 1991–1996 in the cited study of 66,000 accounts. UC Davis investor underperformance: 6.5% per year - Investors lagged the market by this amount in the study. Broad index advantage over active funds: 1.8 percentage points annually - SPIVA-based claim that broad indexes beat average actively managed funds. Long-term outcome for broad U.S. total market fund: better than more than 90% of active stock funds - Over the 20 years ending mid-2023. Best days missed impact: 11.2% to 9.2% - If an investor misses the 10 best days over 26 years, average annual return falls materially. More best days missed impact: 11.2% to 7.7% - If the 20 best days are missed over 26 years, returns drop further. Severe best-days miss impact: 11.2% to 6.4% - Missing the 30 best days out of 10,000 trading sessions sharply reduces long-run returns. Average investor years considered: 20 years ending mid-2023 - Time horizon used in discussing passive fund performance. Average relationship duration for Yale-style managers: 14 years - Ellis notes unusually long manager relationships under David Swensen.

Pivotal Quotes: "We are surrounded by temptations to be wrong in both investing and in life." — Charlie Ellis: Explaining why behavioral biases and emotion repeatedly harm investor decisions. "The grim reality is clear: active investing is not able to keep up with, let alone outperform, the market index." — Charlie Ellis: Summarizing the book’s central case for indexing over active management. "Every investor today has three great gifts: time, compounding, and ETF and indexing." — Charlie Ellis: His closing framework for what modern investors should rely on.

Implications: For most listeners, the takeaway is to focus less on prediction and more on disciplined, low-cost, long-term investing. The industry’s edge has shifted from stock picking to reducing friction, avoiding mistakes, and staying invested through compounding.