Memory chip mania isn’t going away, with Dan Kim

Episode Summary

Executive Summary: The episode explains why memory chips have become the hottest part of the semiconductor market: AI data centers are driving demand sharply higher while new supply lags by years, causing historic price spikes and allocation shortages. Dan Kim argues this is a structural, prolonged upcycle that is reshaping chip economics, boosting Chinese ambitions in memory, and forcing the U.S., Korea, and Japan to treat memory as strategically important.

Main Topics: Explosive memory-chip market tightness (Priority: 5/5): DRAM and NAND prices are surging because AI demand is rising faster than supply, creating shortages even for customers willing to pay more. Why the shortage happened (Priority: 5/5): Memory makers cut output and delayed expansion during the 2023 downturn, then AI demand accelerated unexpectedly, leaving the industry unable to respond quickly. Industry structure and barriers to entry (Priority: 5/5): Memory is a commodity-like, scale-intensive, technologically demanding business dominated by a few firms, making entry and market-share gains difficult. China’s memory-chip strategy (Priority: 5/5): Chinese firms YMTC and CXMT are advancing with heavy state support, but remain constrained by technology limits and restricted access to Western equipment. Geopolitics and strategic importance (Priority: 4/5): The shortage reinforces that memory chips are strategic assets, prompting governments in the U.S., Korea, Japan, and China to support domestic capability. Advanced logic, packaging, and export controls (Priority: 4/5): China is making progress in legacy foundries, compound semiconductors, and advanced packaging, but still lags in leading-edge logic due to lithography constraints. U.S. policy and CHIPS Act execution (Priority: 3/5): The U.S. has made progress in domestic advanced logic and memory support, but policy predictability remains crucial for long-term investment.

Key Arguments: Memory chips are in an unprecedented upcycle: demand from AI data centers is rising while new supply will not arrive in meaningful volume until 2028. Price signals are failing in parts of the market: buyers can offer higher prices and still only receive partial allocations. The shortage is broad-based, affecting not just AI hyperscalers but also automakers, medical-device makers, smartphones, and other electronics. Memory is a major cost component in consumer devices; rising DRAM and NAND prices could materially increase the memory share of an iPhone bill of materials. The current squeeze began after memory firms rationally cut production in response to the 2023 downturn, but AI demand surged far beyond expectations. Memory manufacturing is extremely hard to enter because it requires massive scale, technological sophistication, and durable discipline through brutal cycles. Chinese firms are the major exception to entry barriers because state support is unusually large, allowing them to keep investing despite market challenges. YMTC is already a meaningful NAND supplier, while CXMT is advancing in DRAM but remains behind due to lack of EUV access. China’s chip strategy is not limited to memory; it is also gaining ground in legacy foundries and compound semiconductors. Export controls slow China but do not stop it; if restrictions were removed, China would likely advance faster. The U.S. CHIPS Act has helped restart domestic advanced logic and some memory investment, but more predictability in trade, labor, and capital policy is needed. South Korea appears most explicitly to recognize memory as a strategic asset and is building new production clusters to stay competitive.

Data Points: Memory market craziness rating: 8/10 now, rising to 9 next quarter and 10 by the following quarter - Dan Kim’s qualitative assessment of market tightness DRAM price increase: Over 200% year over year - Expected increase from last year to this year New supply timing: No significant new supply until at least 2028 - Current memory shortage outlook Memory component share in an average phone: 15%–25%, potentially 30%–50% - Impact of rising DRAM and NAND prices on smartphone bill of materials Memory fab build time: 2 to 6 years - Time from decision to new chip output, depending on site and equipment readiness Mainstream DRAM suppliers: 3 companies - Samsung, SK Hynix, and Micron dominate DRAM production YMTC NAND market share: 10%–15% of bits - Estimated current share in NAND US share of DRAM market: Above 60% - Projection driven by AI build-out and high-value demand Chinese foundry node: N+3 / 6 nm - Latest node referenced for SMIC relative to TSMC’s earlier nodes Advanced logic progress in US: TSMC Arizona Fab 1 yielding well; Fab 2 underway; Intel producing 18A; Samsung expanding in Texas - Examples of progress under U.S. industrial policy

Pivotal Quotes: "Right now, it's an 8. Next quarter, it'll be a nine. And the quarter after that, it'll be a ten." — Dan Kim: Describing how extreme the memory-chip market is "There is no new supply coming online in significant volume until at least 2028." — Dan Kim: Explaining why the shortage is likely to persist "The only exception to that are Chinese firms. And that's because there is almost no end to the state support that they're receiving to survive in the business." — Dan Kim: Summarizing why China is able to remain a serious entrant in memory

Implications: Expect elevated chip prices, allocation shortages, and supply-chain stress to persist for years. Memory is now a strategic industrial asset, so governments and firms will likely keep investing, while China’s role in future market cycles remains a major policy risk.