Episode Summary
Executive Summary: Archie Abrams explains Shopify’s unconventional growth philosophy: maximize entrepreneurship by lowering barriers to starting, measure success by long-term cohort GMV rather than retention or local conversion rates, and use long-horizon holdout experiments to catch pull-forward effects. The company pairs strong founder taste with minimal KPI dependence, a rigorous review process, and a product org structured to balance long-term core vision with growth experimentation.
Main Topics: Shopify’s mission-driven growth model (Priority: 5/5): Shopify optimizes for increasing entrepreneurship on the internet, not for keeping every merchant alive forever. Lowering friction to start is central because a few huge winners can outweigh many small or failed merchants. Long-term experimentation and holdouts (Priority: 5/5): The team keeps long-term holdouts for experiments and revisits results at 3, 6, 9, 12 months and beyond to see whether short-term lifts persist or merely pull forward success. Absolute outcomes over funnel conversion rates (Priority: 5/5): Shopify avoids teams optimizing for local conversion rates, because that often incentivizes making prior funnel steps harder. Instead, teams are oriented toward absolute numbers and total cohort value. Org design: core, merchant services, growth (Priority: 4/5): The company intentionally separates time horizons: core builds for the 100-year future, merchant services for medium-term needs, and growth manages the end-to-end customer journey. Taste, intuition, and the ban on KPIs in core (Priority: 4/5): Core product decisions are driven by conviction, taste, and long-term vision rather than KPIs or OKRs, with a few leaders like Toby and Glenn enforcing quality and product bar. Cross-functional collaboration and hybrid journeys (Priority: 4/5): Growth works closely with core and sales, including hybrid self-serve + sales paths, requiring better attribution, incrementality measurement, and human trust across teams. Practical growth levers: onboarding, friction, and incentives (Priority: 4/5): The biggest wins often come from reducing monetary friction, improving onboarding, and better personalization—not from clever retention hacks or superficial conversion optimization.
Key Arguments: Shopify should lower barriers to starting a business because the company wins when a subset of merchants become very large, even if many others churn early. Optimizing local funnel conversion rates can be counterproductive because teams may increase conversion by making the previous step harder rather than genuinely improving outcomes. Long-term holdout analysis frequently reveals that short-term wins are overstated; roughly 30–40% of experiments that look positive early show no long-term GMV lift. The right success metric is cohort-level GMV over years, since Shopify monetizes with merchants as they grow, especially through payments tied to merchant success. Core product can function without KPIs because leadership taste and a strong 100-year vision can replace metric-driven management, though this requires unusually strong founders and leaders. Sales creates attribution complexity because merchants can move between self-serve and sales-led journeys, so Shopify increasingly relies on incrementality rather than only multi-touch attribution. Reducing monetary friction can unlock higher-quality merchants by giving them more time or runway to become successful rather than merely attracting lower-quality users. Great onboarding and personalized setup are major growth levers, even for a company that does not center retention as a primary goal. Shopify’s product and growth teams are deliberately designed to think differently but collaborate through trust, reviews, and shared quality standards. The company’s no-wizard principle pushes growth to embed guidance directly into the product rather than rely on separate onboarding overlays or carousels.
Data Points: Shopify share of U.S. e-commerce: about 10% - Archie describes Shopify’s overall scale in the U.S. 2023 global GMV: $235 billion - Total GMV processed globally by Shopify in 2023. Comparable economy size: roughly the size of Finland's economy - Used to illustrate the scale of Shopify’s 2023 GMV. Long-term no-lift rate after short-term wins: 30–40% - Archie estimates the share of experiments that show early lift but no long-term incremental GMV. Growth org size: over 600 people - Archie leads product, design, engineering, data ops, and growth marketing across growth. Long-term experiment ping cadence: 3, 6, 9, and 12 months - Experimenters are automatically re-queried with updated results over time. Core review cadence: every 6 weeks - R&D leaders review every project with Toby and each other on a six-week cadence. Platform/customer outcomes reviewed over time: 1, 2, 3+ years - Long-term downstream effects of experiments are tracked across multiple years. Growth marketing channels: 7+ major channels - Paid acquisition, media buying, affiliate marketing, email, content, SEO, and offline/online motions are discussed. Experiment holdout size: 5% across the board; 50/50 for new-merchant experiments - Describes Shopify’s experimentation setup, with broader quarterly holdouts and specific A/B splits for new users.
Pivotal Quotes: "the best way to get more people to get to a step is just get more people in the door in the first place. That will always hurt your conversion rate, but it may actually give you more people on the outside." — Archie Abrams: Explaining why Shopify emphasizes absolute outcomes over funnel conversion rates. "The way we think about churn is really going back to Shopify as a kind of our mission and what we want to do, which is to increase the amount of entrepreneurship on the internet." — Archie Abrams: Why Shopify tolerates early churn and focuses on lowering startup barriers. "The plan is the plan until it's not." — Archie Abrams: Archie’s personal leadership motto balancing focus with adaptability.
Implications: For growth teams, the episode argues for measuring true long-term value, not local funnel wins. Companies with strong founder vision can benefit from fewer KPIs, but only if they enforce taste, quality, and rigorous long-horizon learning.
About Lenny's Podcast
Lenny Rachitsky interviews world-class product leaders and growth experts about building products and growing careers.