Big Technology Podcast
Big Technology Podcast

New ROI Questions For AI, Microsoft’s Empire Plans, Jassy’s Amazon Comeback

Tom Dotan from the Wall Street Journal joins us for our weekly discussion of the latest tech news. We cover 1) What slow growing GenAI consumer usage says about the field 2) OpenAI's five levels of AI sophistication 3) Why enterprise rollouts of AI technology are moving slow 4) Is AI a startup

Featured Speakers

Alex Kantrowitz Host

Topics Discussed

Episode Summary

Executive Summary: The episode examines a widening gap between AI hype and real adoption: ChatGPT usage appears to be plateauing, enterprise deployment remains limited, and investors may have overestimated near-term returns. The discussion argues AI is real but slower-moving, with incumbents like Microsoft and Amazon best positioned to benefit, while startups face pressure from high costs, commoditization, and delayed product-market fit.

Main Topics: AI hype vs. actual adoption (Priority: 5/5): The hosts question whether the AI boom is delivering on its promises, citing stagnant consumer usage and weak repeat engagement with ChatGPT despite enormous attention. Consumer AI usage plateau (Priority: 5/5): They discuss the lack of a fresh ChatGPT user number from OpenAI and the possibility that growth has slowed after the initial surge, suggesting the product may be useful but not indispensable for most users. Enterprise AI adoption is slower than expected (Priority: 5/5): The conversation highlights that most companies are still piloting AI rather than deploying it, with consultants and large firms testing rather than fully trusting AI systems in production. OpenAI's capability roadmap and its risks (Priority: 4/5): OpenAI’s publicized levels of AI progress are treated cautiously; the speakers note that if the models fail to advance as promised, the company may have overcommitted to a roadmap it cannot yet fulfill. Incumbents and scale advantage (Priority: 4/5): Microsoft, Amazon, Google, and NVIDIA are portrayed as the main winners so far because AI rewards scale, infrastructure, and existing enterprise relationships more than startup disruption. Small models, efficiency, and product-market fit (Priority: 4/5): The speakers argue that many businesses need smaller, cheaper, task-specific models rather than massive general-purpose systems, implying the market may shift toward efficiency over AGI ambitions. Amazon’s comeback and the tradeoff between ambition and discipline (Priority: 3/5): Amazon’s strong financial rebound under Andy Jassy is contrasted with employee complaints about reduced inspiration and increased focus on costs, raising questions about how much moonshot ambition the company will keep.

Key Arguments: ChatGPT’s initial viral success has not been matched by sustained repeat usage, which suggests the AI revolution may be useful but not yet transformative for most consumers. OpenAI’s latest public/user figure remains 100 million, with only whispers of growth to around 200 million, indicating slower-than-expected expansion. Enterprise AI adoption is lagging: companies are largely exploring or piloting, not deploying, because the tools are still insufficiently reliable and hard to integrate. Publicly defining AI 'levels' may help OpenAI frame progress, but it also creates a credibility risk if the technology does not improve quickly enough. AI is following a pattern similar to self-driving cars: the technology may eventually work, but timelines are much longer than early evangelists predicted. The big tech incumbents are the best positioned to capture AI value because they own distribution, cloud infrastructure, capital, and enterprise relationships. Startups are squeezed between expensive foundation models and commoditization, making it hard to build durable businesses unless they solve specific, narrow problems. Businesses often do not need frontier models; they need smaller, cheaper models tailored to a task, which shifts the commercial opportunity toward efficiency. AI’s economics, not just its capabilities, are likely to determine which products survive and which companies win. Amazon’s operational discipline may improve profitability, but it risks dampening the visionary culture that made it a standout innovator. Microsoft’s relationship with OpenAI is strategically valuable but also risky because the company is dependent on an outside partner it does not control. Microsoft is hedging that risk by investing in and building alternative AI capabilities, including internal models and outside investments like Mistral and G42.

Data Points: ChatGPT user count: 100 million - The most recent official number from OpenAI mentioned during the discussion. Whispered estimate of ChatGPT users: 200 million or a little more - A speculative figure mentioned as an unconfirmed possibility for current ChatGPT usage. Gartner survey production adoption: 21% - Share of surveyed organizations that said they had generative AI in production. Gartner survey size: more than 1,000 organizations - The sample size referenced for the AI adoption poll. Accenture gen AI work: $300 million - Reported amount of generative AI work done for clients, cited as evidence of many pilots but limited deployment. Accenture AI products: 300 products - Used to illustrate the point that the volume of pilots does not equal production deployment. Sequoia AI revenue gap: $500 billion - Estimated additional revenue AI would need to generate to justify the scale of investment. Microsoft market-cap gain: more than $1 trillion - Incumbent winners discussed as benefiting massively from the AI wave. Amazon investment in Anthropic: $4 billion - Described as a completed investment in the AI startup. Microsoft investment in G42: $1.5 billion - A large strategic investment in an Abu Dhabi-based AI startup. Amazon layoffs: almost 27,000 jobs - Cost-cutting after pandemic-era overexpansion and slowing demand. Amazon operating income: $15.3 billion - Largest quarterly profit in Amazon's history, used to show Jassy's turnaround. Amazon valuation milestone: $2 trillion - Amazon hit this market-cap level for the first time amid its comeback. Uber stock comparison: $21/share in July 2022 vs. $72/share today - Used as an analogy for how investor sentiment can shift dramatically after a period of criticism.

Pivotal Quotes: "If this is the amazing magical thing that will change everything, why do most people say, in effect, very clever, but not for me, and wander off with the shrug?" — Bendik Evans (quoted by host): Critique of ChatGPT’s weak repeat usage and unclear consumer value. "What happens when the utopian dreams of AI maximalism meet the messy reality of consumer behavior and enterprise IT budgets? It takes longer than you think." — Bendik Evans (quoted by host): Core thesis that AI adoption is slower and messier than evangelists predicted. "It's a co-pilot. It's something to sit alongside you. It's not autonomous." — Tom Dotan: Explaining Microsoft’s framing of AI as assistance rather than full replacement.

Implications: AI appears real but overhyped in the short term. Expect slower enterprise adoption, more pressure on startups, and continued advantage for incumbents with scale. The winners may be those who build cheaper, narrower, practical AI tools rather than chasing immediate AGI narratives.

🔓 Sign Up for Unlimited Episode Search

About Big Technology Podcast

The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Alex Kantrowitz, a Silicon Valley journalist who's interviewed the world's top tech CEOs — from Mark Zuckerberg to Larry Ellison — is the host.

View all episodes from Big Technology Podcast