My First Million
My First Million

Brutally honest guide to not losing money in the market

Get our Investment Guide: https://clickhubspot.com/klsr Episode 832: Sam Parr ( https://x.com/theSamParr ) and Shaan Puri ( https://x.com/ShaanVP ) talk to legendary fund manager Barry Ritholtz( https://x.com/Ritholtz ) about the behaviors that destroy returns for investors and how to avoid them. —

Featured Speakers

Sam Parr & Shaan Puri HostBarry Ritholtz Guest

Topics Discussed

Episode Summary

Executive Summary: Barry Ritholtz argues that most investors should stop trading, embrace low-cost broad index funds as the portfolio core, and treat active bets as small “decorations” or a controlled “cowboy account.” He emphasizes behavioral finance, humility, and the danger of forecasting, panic selling, and emotional decision-making, while also explaining direct indexing, tax-loss harvesting, and the media’s tendency to overhype noise instead of long-term investing basics.

Main Topics: Core index investing and the 'Christmas tree' portfolio (Priority: 5/5): Ritholtz recommends making broad, low-cost index funds the majority of a portfolio and using small satellite positions only as optional, speculative additions. He frames active ideas as decorations on a stable tree, not the tree itself. Behavioral finance and investor psychology (Priority: 5/5): He traces market mistakes to emotions, cognitive biases, and poor decision-making rather than lack of intelligence. His career shift from trading law to behavioral finance came from observing randomness and inconsistency on a trading desk. Selling mistakes and panic selling (Priority: 5/5): The conversation highlights evidence that panic sellers often never return to equities, and that even professional managers tend to execute poor sells. Selling decisions are frequently more emotional than buys. Direct indexing and tax-loss harvesting (Priority: 4/5): Ritholtz explains how direct indexing can create tax alpha by harvesting losses in concentrated or taxable portfolios, especially useful for founders, IPO holders, or people with large embedded gains. Humility, forecasting, and the limits of prediction (Priority: 5/5): He repeatedly argues that nobody reliably knows the future, that forecasts are often garbage, and that public commentators frequently overstate confidence. He presents this humility as central to better investing. Media noise versus long-term investing truth (Priority: 4/5): Ritholtz says financial media survives by sensationalizing conflict and trading ideas, while the real investing message is boring and repetitive: own diversified indexes, rebalance, and avoid ruin. Career stories and investment legends (Priority: 3/5): The episode includes anecdotes about Warren Buffett, Lloyd Blankfein, Elon Musk, David Rubenstein, and others to illustrate pattern recognition, contrarian thinking, and the danger of overconfidence.

Key Arguments: Broad, low-cost index funds should be the core of most portfolios because very few active managers beat the index consistently over time. Active investing should be treated as a small, optional satellite position; the odds of underperforming are much higher than the odds of winning. Behavioral mistakes—panic, impatience, FOMO, and overconfidence—cause most investor harm, not a lack of intelligence. Selling is often worse than buying; even professionals tend to make emotional, value-destructive sell decisions. Direct indexing is useful primarily for tax management and highly concentrated portfolios, not as a default solution for everyone. Investors should recognize when they have already “won” financially and avoid taking unnecessary risk just to chase more wealth. Financial forecasts are inherently unreliable, so listeners should demand humility and track records before trusting pundits or research sources. Media and online finance content are optimized for attention, not for long-term investor outcomes, so they should be consumed skeptically.

Data Points: Active managers beating the index in any given year: less than half - Used to show how hard it is for active strategies to outperform in a single year. Active managers beating the index over 5 years: about 21% - Ritholtz cites this to show persistence of outperformance is rare. Active managers beating the index over 10 years: less than 10% - Supports the case for indexing over active management. Value in the market coming from stocks: 1% to 2% - Citing Hendrik Bessembinder’s research to show most stocks do not drive long-run market gains. Panicked sellers who never return to equities: about one-third - Behavioral finance data cited during discussion of market crashes. Potential loss after a 57% crash: $1 million falling to about $450,000 - Illustrative example of selling during a crash and missing subsequent compounding. Long-run value if not sold: about 10x - Example showing the opportunity cost of being out of equities during recovery and compounding. Direct indexing loss-harvesting benefit: 75 to 85 basis points - Estimated annual tax benefit from harvesting losses in taxable accounts. Q1 2020 direct indexing harvested losses: 400+ basis points - Cited from O'Shaughnessy research during the pandemic crash. VOO assets under management: over $1 trillion - Referenced as proof of massive adoption of low-cost indexing. Vanguard/BlackRock assets: about $25 trillion combined - Used to illustrate dominance of passive/indexing platforms. Ritholtz Wealth last SEC ADV filing: $7.6 billion - Firm size as of the last reported ADV update in the transcript. Firm launch growth rate: about 30% annually - Ritholtz describes sustained growth since launching in 2013. Firm staffing at $1 billion AUM: about 35 people - Used to describe how heavily staffed the firm was relative to peers. Robinhood missed investment valuation: $80 million - Ritholtz says he passed on investing in Robinhood at this valuation. Carlisle Group AUM: $500 billion - Mentioned while discussing David Rubenstein’s success.

Pivotal Quotes: "Oh my God, put the phone down. Stop trading." — Barry Ritholtz: His first blunt answer to the question of what would make someone a better investor. "The core of your portfolio is a broad index... the tree is the garland, the decoration, the lights, the tinsel." — Barry Ritholtz: Explaining his portfolio construction metaphor for keeping index funds as the base and active bets as small extras. "90% of everything is crap." — Barry Ritholtz: Used to explain why most finance content and market commentary should be treated skeptically.

Implications: Listeners should prioritize passive core investing, behavior control, and tax-aware portfolio management over trading and prediction. The finance industry may reward noise, but long-term success comes from discipline, humility, and avoiding catastrophic mistakes.

🔓 Sign Up for Unlimited Episode Search

About My First Million

Sam Parr and Shaan Puri brainstorm new business ideas based on trends & opportunities they see in the market. Sometimes they bring on famous guests to brainstorm with them.

View all episodes from My First Million