Episode Summary
Executive Summary: The episode traces NVIDIA’s evolution from a gaming GPU maker to the foundational platform for AI, scientific computing, data centers, and simulation. The hosts emphasize Jensen Huang’s long-term, high-risk bet on CUDA and parallel computing, NVIDIA’s repeated near-death moments, and the company’s eventual dominance as deep learning and enterprise AI exploded. They also assess current bull and bear cases, including custom silicon threats and the Omniverse vision.
Main Topics: From gaming chips to programmable GPUs: NVIDIA’s early advantage came from rapid six-month chip cycles, writing its own drivers, and making GPUs programmable via shaders and CG, which created a developer ecosystem around gaming hardware. CUDA as the company-defining bet: CUDA transformed NVIDIA from a graphics company into a full-stack parallel computing platform. The hosts stress how massive, expensive, and initially unproven this investment was, but also how central it became to the company’s moat. The AI breakthrough and AlexNet: ImageNet and AlexNet proved deep learning could run effectively on NVIDIA GPUs, turning years of Jensen’s vision into the foundation of modern AI and massively expanding demand for NVIDIA hardware and software. Data center expansion and platform economics: NVIDIA moved from consumer graphics into enterprise data centers, selling high-margin integrated systems, networking, and DPU-enabled infrastructure, with Mellanox strengthening its data center stack. Adjacent bets: mobile, automotive, crypto, and Omniverse: Not every expansion worked, but the company used mobile, automotive, crypto, and simulation to explore future markets. Some became meaningful niches; others mainly reinforced the broader platform strategy. Competitive threats and valuation debate: The hosts weigh AMD, Google TPUs, Cerebras, Graphcore, and in-house silicon efforts from hyperscalers and device makers against NVIDIA’s moat, while noting the stock’s very high valuation and dependence on continued growth. Current business scale and investor narrative: The episode ends with NVIDIA framed as a platform company with Apple-like margins, strong cash generation, and a trillion-dollar opportunity narrative, but one that still needs physical-world AI to justify its market cap.
Key Arguments: NVIDIA’s early driver stack and six-month launch cadence created quality and speed advantages that competitors couldn’t match. CUDA was a platform bet, not a feature bet; it required compilers, SDKs, evangelism, and years before it mattered commercially. Deep learning’s success on GPUs was not predicted by NVIDIA, but the company recognized it quickly and aligned the whole business around it. The market for GPU computing only became large enough to justify CUDA once AI and data center workloads emerged. NVIDIA’s gross margin and operating margin expansion reflect packaging hardware, software, and systems into a single integrated solution. The company repeatedly survived apparent dead ends by not abandoning long-horizon bets after stock drawdowns or missed earnings. Data center customers are willing to pay far more than consumers, which is why NVIDIA can sell chips and systems at premium prices. The main bear cases are custom silicon from hyperscalers and specialized alternatives that could beat general-purpose GPUs on certain workloads. Omniverse may become an enterprise simulation layer for testing real-world changes before deployment, extending NVIDIA beyond compute into digital twins.
Data Points: GeForce release cadence: 6 months - The company shipped new major GPU products at a six-month cadence in the early 2000s. CUDA employees with CUDA in title: 1,100 - The hosts found roughly 1,100 NVIDIA employees with CUDA in their title on LinkedIn. CUDA developers: 3 million - NVIDIA said it now has about 3 million registered CUDA developers. NVIDIA SDKs: 450 - NVIDIA announced hundreds of SDKs/models in its platform ecosystem. New SDKs/models announced at GTC: 660 - The company announced 660 new ones at the referenced GTC. Gross margin today: 66% - The hosts cited NVIDIA’s current gross margin as evidence of platform power and pricing strength. Operating margin: 37% - Despite being a hardware company, NVIDIA’s operating margin was cited as very strong. Annual revenue: $27 billion - The hosts referenced NVIDIA’s most recent annual revenue at the time of recording. Free cash flow: $8 billion annually - They noted NVIDIA generates roughly $8 billion in free cash flow per year. Cash on hand: $21 billion - The company was described as sitting on about $21 billion in cash. Revenue growth: 60% - They said NVIDIA was growing revenue about 60% year over year. Data center revenue two years prior: $3 billion - The data center segment was about $3 billion two years earlier. Data center revenue now: $10.5 billion+ - The data center segment had grown to over $10.5 billion annually. Gaming revenue two years prior: ~$6 billion - Gaming was still larger than data center two years earlier, at nearly $6 billion. Market cap peak before crisis: just under $20 billion - NVIDIA reached this market cap by mid-2007. Stock drawdown during 2008 crisis: 80% - After an earnings miss and financial crisis, the stock fell about 80%. Stock drawdown in 2011: 50% - Another earnings miss caused a drawdown of about 50%. Crypto winter drawdown: 50% - The stock fell another 50% when crypto mining demand collapsed. Tesla training cluster spend: $50-100 million - The hosts estimated Tesla paid NVIDIA roughly this much for one compute cluster. A100 pricing: $20,000-$30,000 per chip - They contrasted enterprise data center GPUs with consumer cards. Consumer RTX 3090 price: $3,000 - They used this to show the gap between consumer and enterprise pricing. CapEx per year: ~$1 billion - NVIDIA’s capital expenditures were highlighted as very low relative to other large tech firms. ImageNet breakthrough year: 2012 - AlexNet won the ImageNet competition that year and accelerated the deep learning revolution. ImageNet error rate improvement: ~15% vs ~25% - AlexNet beat previous best results by a wide margin, reducing top error substantially.
Pivotal Quotes: "if you don't build it, they can't come" — Jensen Huang: Describing NVIDIA’s rationale for investing heavily in CUDA before the market was obvious. "We've been advancing CUDA and the ecosystem for 15 years and counting" — Jensen Huang: From the Ben Thompson interview, explaining NVIDIA’s full-stack platform strategy. "For fun, our firm has an internal game of what public companies we'd invest in if we were a hedge fund. We'd put in all of our money to NVIDIA." — Mark Andreessen: Cited as a retrospective acknowledgment of NVIDIA’s central role in AI infrastructure.
Implications: NVIDIA’s future depends on sustaining AI/data center leadership while expanding into robotics, automotive, and simulation. If those physical-world AI markets scale, NVIDIA could remain the infrastructure layer for the next computing era.
From the Episode
He certainly has used it since. The way he thought about this was: it wasn't just like, if we build it, they will come, which is what was going on. The phrase he uses is, if you don't build it, they can't come. So it's not even like, yeah, I'm pretty sure if we build it, they will come. It's one step removed from that. It's like, well, if we don't build it, they can't even possibly come. I don't know if they will come, but they can't come if we don't build it. So Wall Street is mostly willing to ignore this in 2006. 2007, 2008. The company's still growing really nicely. This great market cap run leading up to right before the financial crisis. But then, you know, you mentioned last time, I think it gets announced in 2006, maybe and closes in 2007. AMD acquires ATI. And ATI was a very legit competitor. It was the only standing legit competitor to NVIDIA through its whole life. But now AMD acquired it, and I think they.
Weeks ago, Ben Thompson had this amazing interview with Jensen on Strategory. And Jensen, in this interview, I think puts what CUDA is and how important it is, I think, better than I've seen anywhere else. So, this is Jensen speaking to Ben. We've been advancing CUDA and the ecosystem for 15 years and counting. We optimize across the full stack, iterating between GPU, acceleration libraries, systems, and applications continuously, all while expanding the reach of our platform by adding new application domains that we accelerate. We start with amazing chips, but for each field of science, industry, and application, we create a full stack. We have over 150 SDKs that serve industries from gaming and design to life and earth sciences, quantum computing, AI, cybersecurity, 5G, and robotics. And then he talks about what it took to make this. This is like the point we were trying to hammer home here. He says, you have to internalize that this is a brand new programming model, and everything that's associated with being a programmer.
No. Oh, this is awesome. Okay. So it's a couple of years later. So it's like getting more obvious, but it's 2016. And Mark Andreessen gave an interview. He said, We've been investing in a lot of companies applying deep learning to many areas. And every single one effectively comes in building on NVIDIA's platforms. It's like when people were all building on Windows in the 90s or all building on the iPhone in the late 2000s. And then he says, For fun, our firm has an internal game of what public companies we'd invest in if we were a hedge fund. We'd put in all of our Money to NVIDIA. This is like, it was Paradigm, right? That called all of their capital and one of their funds and put it into Bitcoin when it was like $3,000 a coin or something like that. We all should have been doing this. So literally, NVIDIA stock in 20, like recent, like this is now known, 2012, 13, 14, 15. It doesn't trade above like five bucks a share. And NVIDIA today, as we record this, is I think about $220 a share. The high in the past year has been well over 300.
About Acquired
Every company has a story. Learn the playbooks that built the world’s greatest companies — and how you can apply them.