Episode Summary
Executive Summary: Varun Sivaram argues that AI’s soaring electricity demand need not strain the grid if data centers become flexible in when and where they use power. By shifting batchable workloads, moving tasks across regions, and coordinating with batteries and utilities, AI infrastructure could absorb excess capacity, reduce peak stress, lower costs, and accelerate clean energy integration.
Main Topics: AI power demand as a grid crisis: The talk frames rapidly growing AI data centers as a major new electricity load colliding with an aging grid, risking delays, higher prices, and more fossil-fuel use. Flexibility as the solution: Sivaram distinguishes flexibility from efficiency: AI should use energy at different times and places to match grid conditions and unlock stranded capacity. Phoenix demonstration of flexible computing: A real-world test in Phoenix showed 256 GPU servers reducing power use by 25% for three hours during peak demand while maintaining performance. Temporal and spatial flexibility: Batchable AI tasks can be paused or slowed during stress, while some workloads can be moved instantly across regions using fiber networks as 'virtual transmission.' Industry cooperation and software orchestration: The speaker emphasizes that utilities, AI companies, and grid operators must adopt new operating models, with Emerald AI’s software acting as an orchestrator for flexible workloads. Clean energy and grid benefits: Flexible AI data centers could help integrate solar and wind, defer expensive grid upgrades, and buy time for new clean firm power like nuclear or geothermal.
Key Arguments: AI data centers are growing fast enough to collide with an aging electricity grid, creating risks for reliability, affordability, and AI deployment. The biggest opportunity is not reducing total AI energy use, but making it flexible in time and location so it can consume otherwise stranded grid capacity. If data centers trim demand by about a quarter for only a small fraction of the year, the U.S. could host up to 100 gigawatts of new data centers on existing grids. Flexible AI loads can act as shock absorbers, reducing peak stress, avoiding blackouts, and lowering the need for immediate grid expansion. Software can coordinate batchable workloads and geographically shift some AI tasks across data centers, effectively using fiber networks as virtual transmission. The Phoenix demo proves the concept: AI workloads can reduce power draw during peak demand without failing performance requirements. This model could reduce reliance on fossil fuels by making AI demand compatible with more solar, wind, and future clean firm power. Utilities and tech firms need new standards and reference designs so grid-friendly AI factories can be connected faster.
Data Points: Power reduction in demo: 25% - Emerald AI reduced AI data center power consumption during a peak-demand event in Phoenix. Duration of reduction: 3 hours - The flexible load reduction was maintained for the exact period requested by the grid. GPU servers in demo: 256 - Cluster of GPU servers used in the Phoenix demonstration. Potential new data center capacity on existing grids: up to 100 gigawatts - Estimated amount of new data center load that could fit if AI data centers were modestly flexible. Share of year flexibility needed: less than 2% of the year - Flexibility requirement described as brief demand trimming during peak periods. Demand trimming assumption: a quarter - The model assumes data centers reduce demand by 25% during peak stress periods. Unlocked AI investment: $4 trillion - Estimated AI investment that could be enabled without waiting for new infrastructure. U.S. data center power demand today: 4% - Current share of U.S. power demand attributed to data centers. Projected U.S. data center power demand by 2030: 12% - Projected share of U.S. power demand from data centers by 2030. Household power price increase in Columbus, Ohio: $240 per year - Data center demand contributed to higher average annual household electricity prices in 2025. Time to connect new data centers in Virginia: up to 7 years - Illustrates grid interconnection delays in the data center capital of the world.
Pivotal Quotes: "Far from undermining it, AI could actually help save the grid." — Varun Sivaram: Core thesis of the talk: AI data centers can support rather than destabilize electricity systems. "The biggest new user of electricity could actually be our grid's greatest ally." — Varun Sivaram: Introduces the idea that flexible AI demand can become a resource for grid reliability. "It would be like briefly taking 18 wheelers off of that road to let the remaining traffic flow smoothly." — Varun Sivaram: Analogy explaining how temporary AI load reductions relieve peak grid congestion.
Implications: If adopted widely, flexible AI infrastructure could speed AI deployment, reduce grid bottlenecks and costs, and make it easier to integrate clean power. It shifts AI from a burden on the grid to a tool for modernization.
From the Episode
Our team at Emerald AI orchestrated this first-of-a-kind demonstration of flexible AI computing. And we're not alone. Google's also made impressive strides. Scaling up our technologies across the country and around the world could help solve one of the biggest challenges of our time: powering the AI revolution, while also advancing a more reliable, affordable, and clean power grid. Far from undermining it, AI could actually help save the grid. To understand why, we need to reimagine the challenge of powering AI. And so I've reinvented my own career. For 15 years as an energy executive and as America's lead clean energy diplomat, I focused on building more clean energy. But energy supply is just half the equation. And so I founded Emerald AI to focus on the other half: demand. Helping AI intelligently use energy, support grids, and unlock massive stranded power capacity that already exists. Without this capability, we face an impending crisis, a historic collision between two multi-trillion dollar networks: the network of AI data centers that's rapidly growing, and an age.
Average annual household power price in Columbus, Ohio, by $240. And this is just the beginning. As data centers surge from 4% of US power demand today to 12% by 2030, it's like adding another Germany to the US power grid. And third, fossil fuels are set to power the boom in AI data centers, which require reliable power supplies today. In the United States, natural gas is powering most AI growth, and countries like India will see rising coal use increasing global carbon emissions. But it doesn't have to be this way. The biggest new user of electricity could actually be our grid's greatest ally. The key lies in something deceptively simple. Flexibility. That's distinct from efficiency or using less energy overall. Rather, if AI were just a little more flexible in when it uses energy, it could consume vast amounts of otherwise stranded power on today's grids. Think of our electric power system as a superhighway that faces peak rush hour just a few hours per month. Think of that hottest day of the summer in Phoenix, Arizona, when air conditioning demand peaks.
On those days, grids risk being overwhelmed by these massive new data centers that may soon consume more than a gigawatt or more energy than the state of Vermont consumes. But most of the time, power plants are running well below their full capacity and transmission lines are carrying less power than they could, just like that highway. On average, throughout the year, half of the power system's capacity goes unused. What if during those peak rush hour periods? Periods when the grid is truly stressed, AI data centers could dynamically reduce their power consumption and take advantage, otherwise, of all that spare capacity throughout the year. It would be like briefly taking 18 wheelers off of that road to let the remaining traffic flow smoothly. Well, it turns out that if AI data centers were just modestly flexible, just less than 2% of the year, trimming demand by a quarter, just a couple hours at a time. America could fit up to 100 gigawatts of new data centers on existing power grids across the country. That's $4 trillion of AI investment unlocked today without waiting years for new infrastructure. Now, to be sure, America will need even more energy to power our growing economy as data centers, factories, and other users of electricity join. But by making
About TED Talks Daily
Every weekday, TED Talks Daily brings you the latest talks in audio. Join host and journalist Elise Hu for thought-provoking ideas on every subject imaginable — from Artificial Intelligence to Zoology, and everything in between — given by the world's leading thinkers and creators.