AI's Next Bottleneck Is Power, Not GPUs

Jensen Huang and Elon Musk sent the same warning in Washington. The AI race is widening from building better models to supplying power and chips at industrial scale.

"The first thing you need is energy"

At an America.gov event in Washington on Sept. 29, Nvidia CEO Jensen Huang said the starting point of the superintelligence era is power, not GPUs. Even if the whole computing stack changes, he argued, energy sits at the bottom layer that runs the calculations.

The AI revolution starts with code, but the power grid decides its scale.

Musk pointed to the same place. Even if the US leads in software and AI research, he argued, it must also build up power generation and logic and memory chip manufacturing to compete with China over the long run. What the two share is clear: the limits on AI do not sit only inside the algorithms.

10 to 20GW is not just a data center number

Huang estimated that the US is building roughly 10 to 20GW of AI infrastructure a year, and said the process could create about 1 million jobs. The figure is Huang's own estimate from the event, not an official company hiring forecast. It still matters to investors because it shows where AI capex money is flowing.

  • 10 to 20GW: Huang's estimate of annual US AI infrastructure buildout
  • About 1 million: estimated job impact, spanning power generation, data centers, cooling, plumbing and construction
  • 50 years: the timeline Huang described for US reindustrialization

A GPU order is only the start. Without power plants, substations, transmission lines, transformers, gas turbines, liquid cooling, optical networking and construction labor secured alongside it, AI servers become powered-off equipment rather than revenue-producing assets. That is why the AI beneficiary list is widening from semiconductors to utilities and industrials.

Don't take the numbers at face value

  • "China's power is 3 times the US." Musk said this. But IEA data for 2024 electricity demand show China at 9,935 TWh and the US at 4,336 TWh, about 2.3 times. China's physical power advantage is clear, but "3 times" is hard to treat as a precise current figure. (Fact check)
  • "10GW is 25% of new power." The event moderator said this, not Huang. Investment coverage should keep speakers separate. (Attribution)
  • "5GW creates 1% of GDP." This is a hypothetical calculation from Musk. There is no empirical law tying added power to GDP growth one for one. Usage, utilization rates, AI productivity and capital costs all change the result. (Forecast, not fact)

The bottleneck moves from GPUs to grid connection

In the last AI investment cycle, the key bottlenecks were GPUs, HBM and advanced packaging. Now, beyond data center sites and cooling, grid connection itself is becoming the variable that sets the pace of investment. If a customer orders hundreds of thousands of accelerators but the grid hookup is late, revenue recognition and actual AI service delivery are late too.

The shift cuts both ways for Nvidia. If power and infrastructure spending follows, the AI factory market gets bigger. But even with ample GPU demand, delays in power, permitting, transformers or gas turbine deliveries could leave installations unable to keep pace with orders. The risk to watch may be less AI demand than usable power capping the upper end of growth.

Orbital compute is still an option, not earnings

Musk said that over the long term SpaceX and Tesla could aim for 200GW a year of solar production, and that "orbital compute," running AI computing in space, could become a large industry. But this is not a business plan from which current cash flow can be estimated.

Launch costs, heat dissipation, radiation, maintenance, communications, satellite lifespan and orbital congestion all have to be solved. Space data centers are therefore better seen as a long-term option that only has value if Starship reusability and falling launch costs become reality, not as a near-term revenue forecast.

No matter how many GPUs a company buys, AI servers are idle equipment if it cannot bring in the electricity to run them.

Insight Times Editorial Desk

More by topic

Starting with this story's topics, then what readers are following now

Investor psychology, decision-making and books on investing

Data Centers

This story's topic106 storiesSee all →

A building that houses servers and networking gear and supplies them with powe…

Why Nebius Is Keeping Some 2027 AI Capacity Off the Shelf

Nebius mixes long-term contracts, short-term premiums and auctions. Holding back capacity pays only if the servers stay busy, and it is not yet clear the pricing will last.

Tech

AI ran out of memory before it ran out of GPUs

The HBM bottleneck is spreading into DRAM prices, server costs and the price of the next laptop or phone.

Tech

Is Space Cooler for AI? Why Musk Wants Data Centers in Orbit

The next limit on AI may be power and cooling, not GPUs. Elon Musk is looking to Earth orbit for an answer, but the test is cost per hour of compute.

Tech

White House Swaps AI for "SI." The Real Investment Signal Is Infrastructure, Not the Name

An executive order renames artificial intelligence "Super Intelligence" and six frontier labs sign a voluntary safety accord. What investors should watch is the data center, power, nuclear and chip policy now gathered under one national-competitiveness frame.

Tech

Musk Sees the Next Phase of AI Infrastructure: Who Can Switch GPUs On, Fast

If neoclouds struggle under financial pressure, AI demand may not shrink. It may simply favor the few operators with the capital and execution to serve it, a shift that could matter for SpaceX and Tesla.

Tech

Weekly Check: The AI Bull Market Isn't Over, It's Just Gotten Harder

A 5% 10-year yield, 470 gigawatts stacked up in Texas, Chinese DRAM, and whether data centers actually get switched on are starting to decide who wins the AI trade through 2027.

Tech

Is Memory Peaking? In the AI Era, Watch the Bottleneck, Not the Demand

Demand still outruns supply. But memory stocks can peak before demand does. The real question is how long HBM4, server DRAM, CXL and Big Tech capex keep the cash flowing.

Tech

NVDA

This story's topic101 storiesSee all →

Who Hits $1 Trillion Next: Reading AMD and ASML by Different Rules

One company is chasing Nvidia's GPU empire. The other sells the machine that draws the chips for every advanced chipmaker, including Nvidia. Both get floated as 2028 trillion-dollar candidates, but the numbers investors need to watch are entirely different.

Investing

Box Shows AI Its Manuals, and the AI Starts Redesigning the Workflow

Box Architect, built with NVIDIA, moves AI from reading documents to designing how work gets done. It has not yet reached beta, so the real-world payoff remains to be seen.

Tech

Tech Selloff: Is the Bull Market Over? Wall Street's Four-Year Chart Says Not Yet

The uptrend has survived five double-digit pullbacks in four years. This time, AI companies' debt and cash flow are the new variables.

Investing

Marvell's $115 Billion Lumentum Deal: Is AI's Next Bottleneck Light, Not Chips?

Marvell's purchase of Lumentum points to a contest beyond GPU speed, in data transfer and power efficiency. Whether the price is right is not yet confirmed.

Tech

Nvidia and Palantir Put AI Inside the Supply Chain - The Real Shift Is That It's Learning Judgment

A single Vera Rubin rack holds 1.3 million parts. The real breakthrough in Nvidia and Palantir's new supply chain AI isn't automating that complexity, it's capturing the judgment calls that used to live only in planners' heads.

Tech

If You Only Watch Tesla, You May Be Missing Half the AI Story

Nvidia builds the AI brain. Who supplies the electricity to run it? Six power companies Tesla investors should know, and why Tesla's storage business is just one link in the chain.

Investing

Nvidia Moves From GPUs to CPUs as AI Agents Reshape a $200 Billion Chip Market

A customer's early test found Nvidia's Vera CPU handled about twice the AI agent workload of its existing chips. The bigger story is where the money in semiconductors is heading as AI shifts from answering questions to doing work.

Tech

GPU

This story's topic73 storiesSee all →

A chip built to draw graphics, whose ability to run thousands of identical cal…

The Next AI Chip Race Is About How Chips Connect

Applied Materials will lift its stake in Dutch equipment maker BESI from about 9% to 20%. The bet is less about control than about a new way to link chips.

Tech

US AI Data Centers Are Headed for 90GW. Gigawatts Now Matter More Than Dollars

Goldman Sachs expects US data center capacity to grow from 64GW at the end of 2026 to 90GW at the end of 2027. The AI race is moving from buying GPUs to building power plants and transmission lines alongside them.

Tech

Nvidia's $500 Billion Experiment: Wall Street Asks Who Backs the GPU, Not Just the Chip

The real issue in Nvidia's financing platform is not chip sales. It is how far Wall Street will trust GPU resale prices and rental income three to four years out.

Tech

The Cheaper Tokens Get, the Bigger Your AI Bill Gets

As AI shifts from training to inference, the token is becoming an industrial commodity. Falling prices are not cutting demand, because agents and automation consume tokens at a scale no human chat session ever did.

Investing

Dark navy cover. Flow diagram: Nvidia to Nscale (credit guarantee, in talks) to Anthropic (~$45B compute lease signed in August plus a separate ~$45B, ~460MW deal in talks). Title: Why Would Nvidia Back a Customer's Loan?

Why Would Nvidia Guarantee Its Customers' Data Center Loans?

Nvidia is reportedly in talks to back financing for Nscale's West Virginia data center. Nothing is signed, and the terms are not public.

Tech

Two Companies Drive 34% of S&P 500 Earnings Growth as AI Pays Sellers First

Nvidia and Micron generate a third of expected earnings growth in US large caps. Apollo says the financial effect of AI is not yet visible in the S&P 493.

Investing

Amazon Goes After Nvidia's Strongest Moat, and It Is Software, Not GPUs

Amazon's open-source TorchNeuron aims to let existing AI code run on its Trainium chips. The contest comes down to the total cost of AI compute and the return on Amazon's $220 billion in annual capital spending.

Tech

CapEx

This story's topic71 storiesSee all →

Money a company spends on things it will use for years — plants, equipment, bu…

Oracle Sets a Date for AI Payback: $30 Billion in Free Cash Flow by Fiscal 2029

Oracle laid out when its AI data center spending should start returning cash: positive free cash flow in the second half of fiscal 2028 and more than $30 billion in fiscal 2029. The plan only works if contracts hold and customers can pay.

Tech

AI Infrastructure Spending Is Holding Up 3% Global Growth, the IMF Says

AI is acting as a real-economy investment engine, offsetting an energy supply shock. The next test is whether that spending comes back as profit.

Investing

Morgan Stanley Says 'Buy the Drop' on AI Stocks, Keeps $3.4 Trillion Capex Forecast

After a post-midterm selloff on data center regulation fears, Morgan Stanley argues spending is likely delayed, not lost. The winners may differ, though.

Investing

Year Four of the AI Revolution: The Real Winners May Emerge After the Highway Is Built

Railroads, the internet and mobile show that a technology can succeed while many investors lose money. The question for AI is whether the current pullback is the end of the boom or a handoff of wealth to new owners.

Investing

Why the White House Swapped "AI" for "Super Intelligence"

Executive Order 14434 renames AI across the federal government without defining a new technology. The real story is about roughly $700 billion in capex, free cash flow and electricity.

Tech

Looking for the Memory Peak? Watch Capex, Not Prices

Micron's record quarter and surging long-term contracts show AI memory demand has not rolled over. Its aggressive FY27 expansion also gives the first hard numbers on the risk of supply normalizing in 2028.

Tech

Memory Chip Supercycle: Not at Peak Yet, But 5 of 6 Warning Signs Are Flashing

Memory prices are still climbing, but the pace is slowing and PC and smartphone demand is starting to crack under the weight of higher chip costs. This looks less like a price peak and more like a profit plateau building toward the next supply cycle.

Investing