Is Memory Peaking? In the AI Era, Watch the Bottleneck, Not the Demand

Demand still outruns supply. But memory stocks can peak before demand does. The real question is how long HBM4, server DRAM, CXL and Big Tech capex keep the cash flowing.

"Memory has run up too much. Isn't this the top?"

Anyone who has watched memory stocks for a while feels this instinct. When DRAM prices rise and profits at Samsung, SK hynix and Micron surge, the same question always follows: Is this the top of the cycle?

That used to be a fair question. Back when PCs and smartphones drove memory demand, the pattern repeated itself: a good economy meant more orders, chipmakers added capacity, inventory eventually piled up, and prices collapsed.

Something different is happening in AI data centers now. GPUs are not the only thing in short supply. HBM sitting next to the GPU, server-grade DDR5, networking gear, optical components and power are all tight at once. In September 2026, TrendForce said demand from AI servers and agentic AI is pushing up demand for high-capacity server memory faster than supply can expand. Total DRAM industry revenue rose 59.5% quarter over quarter in the second quarter of 2026.

Think of an AI server as a restaurant

GPU — the chef HBM — the counter right in front of the chef CXL memory — the large pantry next door SSD — the bigger cold-storage warehouse

HBM is the fastest option but it is expensive and its capacity cannot be expanded indefinitely. CXL is not a technology meant to replace HBM's speed. It is meant to let more memory be shared and scaled across the servers that need it. The competition ahead is shifting from "how fast is the GPU" to "how cheaply and quickly can the needed data be placed next to the GPU."

Why AI eats so much memory

Generative AI has to keep track of everything said earlier in a conversation to produce an answer. The space that temporarily holds those computed results is called the KV cache. As conversations get longer, as more users are served at once, and as multiple AI agents start working the same problem repeatedly, this memory footprint grows fast.

That means the economics of AI infrastructure are not decided simply by "how fast is one GPU." If an expensive GPU sits idle waiting for data to arrive, the whole system is inefficient. HBM delivers enormous bandwidth right next to the GPU, but package area, heat, yield and cost make it hard to expand capacity freely.

That is where CXL comes in. CXL is an open interconnect that links CPUs, accelerators and memory coherently, enabling memory expansion and pooling. The CXL Consortium released CXL 3.2 in 2024 and unveiled the CXL 4.0 specification in 2026. The key point is not "HBM versus CXL." What matters more is memory tiering: putting the hottest data in HBM, the next tier in CXL DRAM, and the less urgent data in SSDs.

So is memory not at its peak yet?

Based on public data available now, there is no clear sign yet of the kind of demand collapse that typically marks a peak. In September 2026, TrendForce said server DRAM shortages and price strength could continue into 2027. Reuters reported that even smaller PC and smartphone makers are bracing for memory shortages that could persist through at least 2027.

Earnings from the three big memory makers support that picture. SK hynix said it began mass shipments of HBM4 in the second quarter of 2026. Samsung Electronics started mass production and commercial shipments of HBM4 in February 2026 and expects its HBM revenue to more than triple in 2026 from a year earlier. Micron said in its fiscal third-quarter 2026 report that it is now shipping HBM4 in volume to lead customer platforms.

But there is one sentence here that matters more than any of this data: "peak demand" and "peak stock price" do not arrive on the same day.

Memory stocks typically move ahead of earnings. If the pace of price increases slows, if customers have already built up inventory, or if a supplier's new production line ramps faster than expected, the market can start worrying about next year even while profits are still climbing. So translating "supply stays tight through 2027" into "the stock keeps rising through 2027" is a risky leap.

Samsung, SK hynix, Micron: what separates them

CompanyCurrent strengthNext proof point the stock needsKey risk
SK hynixLeading HBM track record, HBM4 mass shipments, high exposure to AI memoryHBM4 yield and customer diversification, whether long-term contracts convert into actual profitIf expectations are already very high, even a small disappointment could trigger sharp volatility
Samsung ElectronicsHolds DRAM, foundry and packaging together, HBM4 commercial shipments underwayProof that HBM4 mix expansion and foundry base-die synergy show up in earningsA complex business mix could dilute the memory boom's impact on overall company value
MicronThe only major U.S.-based DRAM maker, HBM4 mass shipments, strong server memory demandConfirmation of pricing, margins and the 2027 supply-demand outlook in its fiscal Q4 2026 report, due September 30As a near-pure memory play, it is highly sensitive to pricing cycles and valuation swings

All three companies benefit from rising memory prices, but different variables move each stock. For SK hynix, it is how long the company can hold its first-mover premium. For Samsung, it is how much of the trust it lost on HBM4 timing it can win back through actual earnings. For Micron, it is how long strong pricing and margins can be sustained.

For AI investors, look past GPU counts to the whole system

AI infrastructure spending in 2026 does not look like it is in a downturn yet. Alphabet has guided to 2026 capex of $175 billion to $185 billion. Microsoft's calendar-year 2026 capex is expected to be roughly $175 billion, according to Reuters. Reuters has also reported market forecasts that major AI infrastructure spending could top roughly $795 billion in 2026 and cross $1 trillion in 2027.

That money is not all going to GPUs. Google has said roughly 60% of its 2025 capex went to servers and 40% to data centers and networking equipment, and it expects a similar mix in 2026. As GPU performance keeps rising, the bottlenecks in memory, switching, optical networking and power become more visible, not less.

That is why companies like Astera Labs (ALAB) and Marvell (MRVL) matter. Astera Labs posted second-quarter 2026 revenue of $392.4 million, up 104% from a year earlier, and is expanding its CXL, PCIe and switch product lines. Marvell's data center revenue rose 46% year over year in its fiscal 2027 second quarter. Neither company makes the GPU itself. They sit in the layer that connects GPUs, memory and servers so the whole system actually works.

Insight Times Editorial Desk

More by topic

Starting with this story's topics, then what readers are following now

Investor psychology, decision-making and books on investing

HBM

This story's topic75 storiesSee all →

Memory stacked next to the GPU.

AI Chip Peak Check: Demand Still Rising, Risk Building in 2027-2029 Supply and Funding

DRAM and NAND contract prices are still climbing and HBM suppliers hold the edge. Power shortages, AI financing costs and simultaneous memory expansion are the risks for later years.

Investing

Has Memory Peaked? Prices Are Cooling, but the Shortage Looks Set to Run to 2028

Price growth has slowed and consumer demand is already breaking. Server and HBM supply remains short, and Micron says more than 75% of its 2027 volume is already committed to customers.

Tech

The Real ASML Number Isn't the 3% Pop, It's the 30% Capacity Hike

ASML's rally isn't just an AI trade. Customers are already locking in 2027 tool slots, and ASML is raising Low-NA EUV capacity by roughly 30% to keep up.

Investing

2027 Isn't the End: Citi's Case for a Memory Supercycle Running to 2031

Citi says the memory shortage timeline is stretching again. If AI shifts from "train once" models to continual learning, HBM, server DRAM and enterprise SSDs could all fall short at the same time.

Tech

AI Chips Haven't Peaked. The Real Risk Sits in 2028 Supply

HBM and server DRAM shortages are now spreading into enterprise SSDs. The question isn't today's strength, it's how much new capacity these prices are pulling in and when it lands.

Investing

The Next AI Chip Race Is About How Chips Connect

Applied Materials will lift its stake in Dutch equipment maker BESI from about 9% to 20%. The bet is less about control than about a new way to link chips.

Tech

US AI Data Centers Are Headed for 90GW. Gigawatts Now Matter More Than Dollars

Goldman Sachs expects US data center capacity to grow from 64GW at the end of 2026 to 90GW at the end of 2027. The AI race is moving from buying GPUs to building power plants and transmission lines alongside them.

Tech

Data Centers

This story's topic99 storiesSee all →

A building that houses servers and networking gear and supplies them with powe…

Nvidia and Palantir Put AI Inside the Supply Chain - The Real Shift Is That It's Learning Judgment

A single Vera Rubin rack holds 1.3 million parts. The real breakthrough in Nvidia and Palantir's new supply chain AI isn't automating that complexity, it's capturing the judgment calls that used to live only in planners' heads.

Tech

Why the White House Swapped "AI" for "Super Intelligence"

Executive Order 14434 renames AI across the federal government without defining a new technology. The real story is about roughly $700 billion in capex, free cash flow and electricity.

Tech

2027 Investing Needs Alignment, Not Prediction

A new investing book argues the hard part was never picking the next winner. It's staying aligned with where value and bottlenecks are moving while keeping old human weaknesses in check.

Investor Mind

AMD Crossed $1 Trillion, and the Market Started Looking at CPUs Again

AMD's stock topped a $1 trillion market cap for the first time. The rally isn't just about being an Nvidia alternative. It reflects a reassessment of AMD as a full-stack AI infrastructure vendor, one that bundles CPUs, GPUs and networking, as AI shifts from chatbots to agents and reignites data center demand for CPUs.</deck> <parameter name="oneline">As AI moves from chatbots to agents, the market has started counting the CPU sitting next to the GPU again.

Tech

Why Nebius Is Keeping Some 2027 AI Capacity Off the Shelf

Nebius mixes long-term contracts, short-term premiums and auctions. Holding back capacity pays only if the servers stay busy, and it is not yet clear the pricing will last.

Tech

DeepSeek's $15 Billion Raise: Model Makers May Feel It Before Nvidia Does

China's DeepSeek is closing a round about twice its original target. For US investors, the question is less the size of the check than where the money goes and whose profits it could erode.

Tech

AI Data Centers Are Rewriting Contracts While They Wait for Power

Oracle's Project Jupiter shows that the AI power shortage is no longer a "2030 forecast." The mere possibility of a delayed power hookup has already triggered a force majeure clause, and it is starting to shake billions in loans and lease-income timelines.

Tech

NVDA

92 storiesSee all →

Amazon Goes After Nvidia's Strongest Moat, and It Is Software, Not GPUs

Amazon's open-source TorchNeuron aims to let existing AI code run on its Trainium chips. The contest comes down to the total cost of AI compute and the return on Amazon's $220 billion in annual capital spending.

Tech

AI's Next Bottleneck Is Money, Not Chips

Broadcom is lending Anthropic up to $42 billion, and Nvidia wants to build a $500 billion market for loans backed by GPUs. The AI race may turn on what rate buyers pay to borrow.

Tech

Two Companies Drive 34% of S&P 500 Earnings Growth as AI Pays Sellers First

Nvidia and Micron generate a third of expected earnings growth in US large caps. Apollo says the financial effect of AI is not yet visible in the S&P 493.

Investing

China's AI Labs Went Open Source Because They Had to, Not Because They Wanted To

A GPU shortfall pushed Chinese AI labs toward efficiency and open weights, and that constraint is now reshaping the global competition over who controls AI's basic infrastructure.

Tech

Nvidia's Next Target After GPUs: Controlling What AI Agents Are Allowed to Do

OpenShell and Sentry are not about policing what an AI says. They are about controlling, at the server infrastructure level, which files and APIs an AI can touch, what it can execute, and who can actually pull the plug when something goes wrong.

Tech

The US-China Summit Didn't Erase Taiwan Risk for Chip Stocks

Washington's Taiwan policy held, but roughly $14 billion in arms sales is still on hold. For AI chip investors, the summit reads less like risk removed and more like a fragile balance extended.

Macro

ASML Is Discussing 2030 Orders. How Long Can the AI Chip Supercycle Last?

Despite bubble worries, ASML sees equipment shortages through 2028. Investors should watch future production capacity, not just today's orders.

Tech

GPU

65 storiesSee all →

A chip built to draw graphics, whose ability to run thousands of identical cal…

Musk Borrowed $40 Billion for GPUs. He Also Warned AI Cloud Firms Could Go Bust

SpaceX's giant financing shows a new dividing line in AI: who borrows matters as much as how much is spent. Firms with other revenue may outlast those that rent out GPUs alone.

Tech

AI Stops Just Talking, Starts Working: The Second Infrastructure Cycle

The center of the AI race is shifting from chatbot performance to agents that finish real work. For investors, what matters is not model rankings but how a single query turns into dozens of inference calls, pulling demand beyond GPUs into CPUs, HBM, networking and power.

Tech

Why Nvidia Is Happy to Help Make AI Models Nearly Free

Falling model prices can squeeze model makers. For Nvidia, the number that matters is the total volume of tokens generated worldwide and the compute that produces them.

Tech

The Number That Matters More Than How Smart AI Gets

This week's AI models got stronger and cheaper at the same time. The chart long-term investors should watch isn't the weekly benchmark leader, it's the falling cost of finishing a task successfully.

Tech

AI Data Centers' Next Bottleneck: Getting Power From the Grid to the GPU

Securing a gigawatt of power does not mean a gigawatt reaches GPU compute. The next fight in AI infrastructure is happening inside the data center, over how little electricity gets wasted before it reaches the chip.

Tech

Nvidia's $1 Trillion Number: How Far Has the AI Infrastructure Supercycle Come

Nvidia now frames Blackwell and Rubin sales opportunity through 2027 at more than $1 trillion. The real story isn't how many more GPUs get sold, it's AI turning into a physical infrastructure buildout spanning chips, memory, networking, cooling and power grids.

Tech

The Cheaper Tokens Get, the Bigger Your AI Bill Gets

As AI shifts from training to inference, the token is becoming an industrial commodity. Falling prices are not cutting demand, because agents and automation consume tokens at a scale no human chat session ever did.

Investing