Big Technology Podcast
Big Technology Podcast

AGI or Bust, OpenAI’s $1 Trillion Gamble, Apple’s Next CEO?

Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover: 1) Why the AI industry needs to get to AGI to make the investments pay off 2) The diverging tracks between AI model improvement and investing in scaling 3) Why the LLM craze may delay the path to AGI 4) So w

Featured Speakers

Alex Kantrowitz Host

Topics Discussed

Episode Summary

Executive Summary: The episode argues that AI infrastructure spending has become dangerously disconnected from model progress and product reality. The hosts question whether OpenAI’s trillion-dollar compute commitments, debt-fueled expansion, and circular dealmaking can be justified absent AGI-level breakthroughs, while also covering Oracle’s thin margins, AI’s macroeconomic importance, Sora’s copyright backlash, and Apple’s likely CEO succession.

Main Topics: AI CapEx frenzy vs. actual model progress (Priority: 5/5): The hosts debate whether massive data-center and compute spending is rational given slowing model gains, diminishing returns from scale, and increasingly uncertain AGI timelines. OpenAI’s trillion-dollar infrastructure commitments (Priority: 5/5): They dissect OpenAI’s deals with NVIDIA, AMD, Oracle, CoreWeave, and Stargate, arguing the scale only makes sense if investors believe in AGI or extreme future monetization. Debt, leverage, and circular financing in AI (Priority: 5/5): The conversation turns to how AI growth is increasingly funded by debt and creative financing, raising concerns about sustainability and potential market fragility. Economics of AI companies and margin compression (Priority: 4/5): Oracle’s deal structure is used as an example of how AI infrastructure businesses may look more like low-margin industrial or retail businesses than high-margin software firms. Sora, copyright, and product backlash (Priority: 3/5): They discuss OpenAI’s text-to-video product Sora, its opt-out copyright approach, and the tension between user delight, creator rights, and platform liability. Apple succession and the search for product vision (Priority: 3/5): The hosts react to reports that John Ternus is a leading Tim Cook successor and argue Apple may need a more product-oriented, technologist-led reset.

Key Arguments: AI infrastructure spending is increasingly premised on an AGI outcome rather than on current product economics or demonstrable research trajectories. Model scaling appears to be yielding diminishing returns, which makes the current wave of compute buildout look disconnected from the science. Even if today’s models can already automate a large share of white-collar work, that does not necessarily require the massive compute spend now being deployed. A third path exists: algorithmic and compute-efficient breakthroughs could deliver strong AI capabilities without the extremely heavy infrastructure bet. The AI race may be concentrating talent inside a small set of labs, starving universities and alternative research paths. Corporate incentives and short time horizons may push frontier labs toward safe, consensus-driven, compute-heavy products instead of risky breakthroughs. AI deals are becoming self-referential: announcements boost stock prices and valuations, which can then be used to justify more spending. Oracle’s AI cloud business demonstrates that AI infrastructure can produce far lower margins than traditional software, challenging standard tech valuations. The macro economy has become unusually dependent on AI-related spending and stock-market gains, making a correction meaningful even if not catastrophic. OpenAI’s Sora strategy suggests a willingness to push copyright boundaries and use opt-out mechanics, which could trigger legal and creator backlash. Apple may need a CEO with more product vision than operational continuity if it wants to regain innovation momentum.

Data Points: OpenAI compute commitments: $1 trillion - Reported value of OpenAI’s annual compute/infrastructure deals discussed from the Financial Times. NVIDIA and AMD deal estimates: Up to $500 billion and $300 billion - Approximate costs of OpenAI’s expected commitments with NVIDIA and AMD. Oracle deal estimate: Another $300 billion - Estimated cost of OpenAI’s computing deal with Oracle. CoreWeave disclosed deals: More than $22 billion - OpenAI computing deals disclosed with CoreWeave. Stargate pledge: Up to $500 billion - OpenAI’s initiative with SoftBank, Oracle, and others for U.S. infrastructure. Compute capacity: More than 20 gigawatts - Total capacity OpenAI could gain from the announced deals over the next decade. Power equivalence: Roughly 20 nuclear reactors - How the podcast characterized 20 gigawatts of compute capacity. Deployment cost per gigawatt: $50 billion - Estimated current cost to deploy one gigawatt of AI compute capacity. OpenAI revenue run rate: $12 billion - Mentioned as ChatGPT’s continuing run-rate revenue. Anthropic revenue run rate: $5+ billion - Mentioned as Anthropic’s current run-rate revenue. OpenAI expected losses: $120 billion by 2029 - Projected losses cited during the discussion. Oracle AI revenue forecast: $381 billion over five fiscal years - Revenue Oracle said it may generate from renting specialized cloud servers to OpenAI and others. Oracle margin on AI rentals: 16% average - The discussion contrasts this with Oracle’s historical software margins. Oracle Blackwell chip losses: Nearly $100 million - Losses from rentals of NVIDIA Blackwell chips in the quarter ending in August. Oracle long-term debt: About $82 billion - Oracle’s long-term debt level at the end of August. Oracle debt-to-equity ratio: About 450% - Used to highlight leverage versus peers. Alphabet debt-to-equity ratio: 11.5% - Comparison point for Oracle’s leverage. Microsoft debt-to-equity ratio: About 33% - Comparison point for Oracle’s leverage. U.S. GDP growth share: 40% - FT-cited share of U.S. GDP growth attributed to AI-company spending. U.S. stock gains share: 80% - AI companies’ share of U.S. stock-market gains so far in 2025. Deutsche Bank recession claim: Close to or in a recession without tech spending - Analyst claim that U.S. growth is heavily supported by AI-related spending. Bain funding gap: $2 trillion annual revenue needed; $800 billion short - Estimate for funding compute demand by 2030. AMD equity incentive: 10% of AMD for a penny a share - Potential stock kicker in the OpenAI-AMD deal described in the transcript. SoftBank margin loans: $5 billion recent loan; $18.5 billion total against ARM shares - Used as an example of AI-related leverage and creative financing.

Pivotal Quotes: "nothing short of AGI will be enough to justify the investments now being proposed for the coming decade" — Dave Kahn: Quoted by the hosts to frame the argument that current AI infrastructure spending only makes sense if AGI arrives. "We are at a stage of the build out that is much further than that" — Host reading Dave Kahn: Describing how the compute spending question has moved beyond the earlier $600 billion debate. "OpenAI is in no position to make any of these commitments" — Gil Uria: FT-cited analyst reaction to OpenAI’s massive compute commitments and funding gap.

Implications: The AI boom is increasingly a macroeconomic and financial-system story, not just a product story. If model efficiency improves or hype cools, valuations, debt structures, and growth assumptions could reprice fast, forcing a reset in how AI companies are valued and funded.

🔓 Sign Up for Unlimited Episode Search

About Big Technology Podcast

The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Alex Kantrowitz, a Silicon Valley journalist who's interviewed the world's top tech CEOs — from Mark Zuckerberg to Larry Ellison — is the host.

View all episodes from Big Technology Podcast