AI's next bottleneck is not silicon. It is electricity

GPUs were scarce, then HBM and advanced packaging. Now the constraint is power delivered to the right place at the right time, and the ability to pull heat out of racks drawing more than 100kW.

The bottleneck never sits still

Watch the AI industry long enough and you notice the constraint keeps moving.

In 2023 the problem was GPUs. How many NVIDIA H100s a company could get its hands on determined how fast it could grow.

Then came HBM and advanced packaging. Having the GPU was not enough if memory and packaging supply ran short.

Now, in 2026, the words that come up far more often are power and cooling.

The point is not the lazy version of the story, that America is running out of electricity.

Power can exist and still fail to arrive at the right location, at the right moment, at the right quality.

An AI data center wants tens of megawatts. Large projects want hundreds of megawatts, or gigawatts. Transmission upgrades, new substations, transformer procurement and interconnection approvals can each take years.

So the new bottleneck is less about total energy than about time to power: when the electricity actually shows up.

Better GPUs make the power problem worse, not better

Intuitively, more efficient chips should ease the strain.

In AI systems, the opposite happens.

Each GPU gets more powerful, more accelerators are packed into a single rack, and high-speed interconnects tie them together. Power density per rack climbs fast.

According to Schneider Electric, a traditional data center rack typically ran somewhere around 10 to 20kW. AI systems have already passed 100kW. GB200-based designs sit at roughly 132kW, GB300 at roughly 142kW, and the newest Vera Rubin generation pushes requirements as high as about 246kW.

Those numbers are not just bigger numbers.

They mean pushing close to ten times the power into the same floor area as before.

And almost all of that power ends up as heat.

The problem of getting electricity in and the problem of getting heat out grow together.

Which is why an AI data center is no longer a building that holds a lot of servers. It is a power and thermal management system that happens to contain computers.

Why air cooling runs out of road

Conventional data centers were built around air. Cold air in, hot air out.

Past roughly 100kW per rack, air alone cannot move the heat.

Hence the rapid spread of direct-to-chip liquid cooling, which brings coolant close to the silicon and pulls heat away at the source. Liquid carries heat far more effectively than air does.

The catch is that liquid cooling is not a box you bolt on.

Piping. CDUs. Pumps. Heat exchangers. Water chemistry. Leak detection. Facility controls. Integrated operation of power and cooling together.

The whole design of the building changes.

In AI infrastructure, cooling is no longer an accessory hanging off the back of a server. It is production equipment, because it determines how much compute you can actually place in a rack.

Power is capacity, not a cost line

In a traditional data center, electricity was mostly an operating expense.

In an AI data center it means something else.

However many GPUs you own, you cannot produce tokens without power.

So the megawatts and gigawatts an operator has secured are not just the size of a utility contract.

They are future AI production capacity.

The analogy is wafer capacity in semiconductors.

A company that can reliably draw 100MW and a company that can draw 1GW differ, over time, in the sheer volume of AI output they can generate.

Seen this way, the core assets of the industry change too.

GPUs. HBM. Networking. Land. Substations. Grid interconnection. Generation. Cooling infrastructure.

These become a single integrated production system.

Which is why the idea that a great model is all you need to win keeps looking less realistic.

The IEA numbers point to local bottlenecks, not a global shortage

The IEA projects global data center electricity consumption reaching about 945TWh by 2030, roughly double the 2024 level.

That is about 15% annual growth.

Within it, power consumption by AI-accelerated servers is expected to grow about 30% a year.

Read alone, those figures make it sound as if data centers will swallow the world's electricity.

But in the IEA's base scenario, data centers account for a little under 3% of global electricity consumption in 2030.

So framing this as "the world is running out of power" gets it wrong.

The real issue is concentration.

Virginia. Texas. Ohio. Arizona. Established hubs such as Northern Virginia.

Grids do not operate on national averages. When large AI campuses cluster in one region, that region's substations, transmission lines and generation plans come under pressure quickly.

The essence of the AI power problem is regional grid availability, not global energy supply.

And in 2026, you also have to verify the demand is real

As the power constraint tightened, a new problem appeared: ghost demand.

Developers file large interconnection requests with several grids at once, then build only some of the projects.

Reuters reported in September 2026 that US data center interconnection requests had swelled past 700GW nationwide, more than ten times current estimated total US data center power use.

Texas eventually paused new data center connections and tightened its process for verifying a project's actual financing and ownership structure.

That shift matters.

If utilities mistake phantom or duplicated requests for real demand and build generation and transmission against it, the cost lands on consumers.

So when you look at AI power demand from here, the announced gigawatt figure is the least useful number. Look instead at committed capital, confirmed interconnection, site control, equipment orders and construction progress.

In AI infrastructure as elsewhere, announced demand and operating demand are different things.

Vertiv's results show how far power and cooling have come

Vertiv is one of the main suppliers of power and cooling infrastructure to AI data centers.

Second-quarter 2026 revenue was $3.274 billion, up 24% year on year.

Adjusted operating profit rose 51%, with an adjusted operating margin of 22.6%.

The company raised its full-year 2026 organic sales growth guidance to roughly 31%.

That is not a growth rate that looks like a traditional industrial equipment company.

It means AI server investment is flowing straight through into orders for power and thermal management gear.

The more telling signal is the M&A.

In September 2026 Vertiv agreed to acquire Utility Innovation Group for up to $2.6 billion. The target works in microgrids, power controls and specialty switchgear.

Why does a cooling company buy a microgrid company?

Because customers no longer ask for a cooling unit.

They want to secure power, connect on-site generation and batteries, and integrate distribution and cooling inside the building, all so they can switch on sooner.

It is about as direct a piece of evidence as you will find that the bottleneck is moving from cooling to the grid, and from the grid to self-supply.

Why Eaton became an AI stock

Eaton looks more like a conventional industrial.

Switchgear. Distribution equipment. Power management. Electrical safety. The various power infrastructure that ties into UPS systems.

It is not the name that shows up in glossy AI investment coverage.

But every new data center needs this equipment.

Eaton's second-quarter 2026 revenue was $8.5 billion, up 21% year on year. Organic growth was 14%. Backlog in the Electrical segment rose 43% year on year. The company names data centers as one of its core growth drivers.

Here is the interesting part of the AI story.

It began as a software revolution, and the money is landing in transformers, distribution gear and cooling systems.

That is the classic pattern of an industrial buildout. The biggest beneficiaries are rarely only the most visible technology companies.

The AI data center is turning into something between a utility and a factory

As high-density AI campuses scale, the operating model changes.

Relying on the grid alone gets shakier, because interconnection can take three or four years while the building itself goes up faster than that.

So the options arrive all at once.

On-site gas turbines. Fuel cells. Battery storage. Solar plus storage. Microgrids. Long-term power purchase agreements. The conversation about nuclear and SMRs.

The data center stops being a passive consumer of electricity and starts designing its own energy system.

Push that further and a large AI campus looks less like a building full of servers and more like a small industrial park.

Generation. Transformation. Distribution. Cooling. Compute.

All integrated on one site.

Which means one measure of a hyperscaler's competitiveness may soon be not its headcount of software engineers but its ability to procure energy and execute infrastructure projects.

Power infrastructure may stay short longer than semiconductors do

GPU supply can rise if you build more fabs.

HBM capacity arrives in time as well.

Grids move differently.

Large transformers. High-voltage transmission lines. Substations. Power plants. Regulatory approval. Local consent. Environmental review.

These projects take years, sometimes more than a decade.

An AI chip's product cycle is one to two years. The investment cycle for power infrastructure is far longer.

That mismatch of timelines is the whole story.

AI companies want to deploy more powerful GPUs every year. The grid does not change at that speed.

So over the medium term, the harder question may not be whether you can get GPUs, but whether you can plug them in and actually turn them on.

When people say the bottleneck in the AI supply chain is moving from semiconductors to power infrastructure, this timeline gap is what they mean.

The production function has to include electricity

Until now, analyzing an AI company meant looking at model performance, GPU counts and user numbers.

Those variables are no longer enough.

Megawatts that can actually run compute. The date those megawatts become available. Power density per rack. PUE. Cooling method. Power cost. Utilization. Share of self-generated power.

These numbers determine AI production capacity.

The production function is no longer GPUs times model.

It is power times grid times cooling times compute times model times demand.

Drop any one term and the system stops.

The larger the industry grows, the more physical infrastructure matters relative to software.

AI appears to live in the cloud. Underneath the intelligence sit transformers, copper, coolant and generators.

To see the next bottleneck, look away from the screen and outside the data center.

You can buy the chips, but if you cannot buy the electricity, no intelligence gets produced.

Insight Times Editorial Desk

More by topic

Starting with this story's topics, then what readers are following now

Investor psychology, decision-making and books on investing

HBM

This story's topic75 storiesSee all →

Memory stacked next to the GPU.

AI Chip Peak Check: Demand Still Rising, Risk Building in 2027-2029 Supply and Funding

DRAM and NAND contract prices are still climbing and HBM suppliers hold the edge. Power shortages, AI financing costs and simultaneous memory expansion are the risks for later years.

Investing

Has Memory Peaked? Prices Are Cooling, but the Shortage Looks Set to Run to 2028

Price growth has slowed and consumer demand is already breaking. Server and HBM supply remains short, and Micron says more than 75% of its 2027 volume is already committed to customers.

Tech

The Real ASML Number Isn't the 3% Pop, It's the 30% Capacity Hike

ASML's rally isn't just an AI trade. Customers are already locking in 2027 tool slots, and ASML is raising Low-NA EUV capacity by roughly 30% to keep up.

Investing

2027 Isn't the End: Citi's Case for a Memory Supercycle Running to 2031

Citi says the memory shortage timeline is stretching again. If AI shifts from "train once" models to continual learning, HBM, server DRAM and enterprise SSDs could all fall short at the same time.

Tech

AI Chips Haven't Peaked. The Real Risk Sits in 2028 Supply

HBM and server DRAM shortages are now spreading into enterprise SSDs. The question isn't today's strength, it's how much new capacity these prices are pulling in and when it lands.

Investing

The Next AI Chip Race Is About How Chips Connect

Applied Materials will lift its stake in Dutch equipment maker BESI from about 9% to 20%. The bet is less about control than about a new way to link chips.

Tech

US AI Data Centers Are Headed for 90GW. Gigawatts Now Matter More Than Dollars

Goldman Sachs expects US data center capacity to grow from 64GW at the end of 2026 to 90GW at the end of 2027. The AI race is moving from buying GPUs to building power plants and transmission lines alongside them.

Tech

Data Centers

This story's topic99 storiesSee all →

A building that houses servers and networking gear and supplies them with powe…

Nvidia and Palantir Put AI Inside the Supply Chain - The Real Shift Is That It's Learning Judgment

A single Vera Rubin rack holds 1.3 million parts. The real breakthrough in Nvidia and Palantir's new supply chain AI isn't automating that complexity, it's capturing the judgment calls that used to live only in planners' heads.

Tech

Why the White House Swapped "AI" for "Super Intelligence"

Executive Order 14434 renames AI across the federal government without defining a new technology. The real story is about roughly $700 billion in capex, free cash flow and electricity.

Tech

2027 Investing Needs Alignment, Not Prediction

A new investing book argues the hard part was never picking the next winner. It's staying aligned with where value and bottlenecks are moving while keeping old human weaknesses in check.

Investor Mind

AMD Crossed $1 Trillion, and the Market Started Looking at CPUs Again

AMD's stock topped a $1 trillion market cap for the first time. The rally isn't just about being an Nvidia alternative. It reflects a reassessment of AMD as a full-stack AI infrastructure vendor, one that bundles CPUs, GPUs and networking, as AI shifts from chatbots to agents and reignites data center demand for CPUs.</deck> <parameter name="oneline">As AI moves from chatbots to agents, the market has started counting the CPU sitting next to the GPU again.

Tech

Why Nebius Is Keeping Some 2027 AI Capacity Off the Shelf

Nebius mixes long-term contracts, short-term premiums and auctions. Holding back capacity pays only if the servers stay busy, and it is not yet clear the pricing will last.

Tech

DeepSeek's $15 Billion Raise: Model Makers May Feel It Before Nvidia Does

China's DeepSeek is closing a round about twice its original target. For US investors, the question is less the size of the check than where the money goes and whose profits it could erode.

Tech

AI Data Centers Are Rewriting Contracts While They Wait for Power

Oracle's Project Jupiter shows that the AI power shortage is no longer a "2030 forecast." The mere possibility of a delayed power hookup has already triggered a force majeure clause, and it is starting to shake billions in loans and lease-income timelines.

Tech

Energy

This story's topic21 storiesSee all →

Generating, moving and selling electricity.

White House Swaps AI for "SI." The Real Investment Signal Is Infrastructure, Not the Name

An executive order renames artificial intelligence "Super Intelligence" and six frontier labs sign a voluntary safety accord. What investors should watch is the data center, power, nuclear and chip policy now gathered under one national-competitiveness frame.

Tech

AI Data Centers' Next Bottleneck: Getting Power From the Grid to the GPU

Securing a gigawatt of power does not mean a gigawatt reaches GPU compute. The next fight in AI infrastructure is happening inside the data center, over how little electricity gets wasted before it reaches the chip.

Tech

Nvidia's $1 Trillion Number: How Far Has the AI Infrastructure Supercycle Come

Nvidia now frames Blackwell and Rubin sales opportunity through 2027 at more than $1 trillion. The real story isn't how many more GPUs get sold, it's AI turning into a physical infrastructure buildout spanning chips, memory, networking, cooling and power grids.

Tech

Jensen Huang Pushes Back: AI's Next Bottleneck Is Power, Not Chips

Facing calls to slow AI down, Nvidia CEO Jensen Huang says the industry needs to move "as fast as possible." But for investors, the real question isn't who wins that philosophical fight, it's whether GPUs, memory, networking and electricity can actually keep pace.

Tech

The AI Bubble Question Has Changed: By Late 2026, It's ROIC Over GPUs

There is no sign yet that AI investment is slowing. If anything, hyperscaler spending forecasts keep climbing. But as the scale of that capital has grown, the market's question has shifted from "is AI growing" to "when, and how much, does this capital come back as cash."

Tech

The Question Markets Asked This Week: Who Controls the AI Bottleneck, Not Who Owns AI

The Fed hiked again and the 10-year topped 5 percent, but the center of the AI trade held. The market is no longer asking whether AI is growing, it is asking who controls memory, power and capital.

Tech

Texas Solar Just Passed Nuclear. The AI Trade Isn't the Panel

Elon Musk says solar's exponential growth will eventually crowd out nearly everything else. The direction checks out, but as AI pushes power demand higher, the money looks more likely to flow into storage, grid gear and transmission than into solar modules alone.

Investing

NVDA

92 storiesSee all →

Amazon Goes After Nvidia's Strongest Moat, and It Is Software, Not GPUs

Amazon's open-source TorchNeuron aims to let existing AI code run on its Trainium chips. The contest comes down to the total cost of AI compute and the return on Amazon's $220 billion in annual capital spending.

Tech

AI's Next Bottleneck Is Money, Not Chips

Broadcom is lending Anthropic up to $42 billion, and Nvidia wants to build a $500 billion market for loans backed by GPUs. The AI race may turn on what rate buyers pay to borrow.

Tech

Two Companies Drive 34% of S&P 500 Earnings Growth as AI Pays Sellers First

Nvidia and Micron generate a third of expected earnings growth in US large caps. Apollo says the financial effect of AI is not yet visible in the S&P 493.

Investing

China's AI Labs Went Open Source Because They Had to, Not Because They Wanted To

A GPU shortfall pushed Chinese AI labs toward efficiency and open weights, and that constraint is now reshaping the global competition over who controls AI's basic infrastructure.

Tech

Nvidia's Next Target After GPUs: Controlling What AI Agents Are Allowed to Do

OpenShell and Sentry are not about policing what an AI says. They are about controlling, at the server infrastructure level, which files and APIs an AI can touch, what it can execute, and who can actually pull the plug when something goes wrong.

Tech

The US-China Summit Didn't Erase Taiwan Risk for Chip Stocks

Washington's Taiwan policy held, but roughly $14 billion in arms sales is still on hold. For AI chip investors, the summit reads less like risk removed and more like a fragile balance extended.

Macro

ASML Is Discussing 2030 Orders. How Long Can the AI Chip Supercycle Last?

Despite bubble worries, ASML sees equipment shortages through 2028. Investors should watch future production capacity, not just today's orders.

Tech