2027 Isn't the End: Citi's Case for a Memory Supercycle Running to 2031

Citi says the memory shortage timeline is stretching again. If AI shifts from "train once" models to continual learning, HBM, server DRAM and enterprise SSDs could all fall short at the same time.

Photo Jarred Trost · CC BY-SA 2.5 · Wikimedia Commons

AI MEMORY

The memory supercycle timeline just stretched from 2028 to 2031

Until now, the bullish case in the memory industry ran roughly like this: 2027 is the tightest year, and starting in 2028 new supply gradually catches up. Citi's global semiconductor report, released September 14, pushes that timeline out further.

Citi argues that as AI moves beyond simple training and inference into continual learning, the global memory shortage could persist through 2031. The report goes further, suggesting that 2028 supply-demand conditions may actually get worse rather than better.

The real shift isn't how large AI models get. It's how often AI absorbs new knowledge, how long it retains what it has already learned, and how many users' states it must hold in memory at once.

If that view holds, the nature of memory demand changes. It's no longer just about needing a large batch of HBM to train a model once. Server DRAM and SSDs would need to keep growing continuously as long as the service is running.

Citi's numbers are aggressive

  • -8.7%: Citi's projected 2027 DRAM supply-demand gap
  • -9.7%: Projected 2028 DRAM supply-demand gap, a wider shortfall than 2027
  • +62%: Projected 2027 HBM bit demand growth
  • +69%: Projected 2028 HBM bit demand growth

Citi expects global DRAM bit demand to rise about 30.2% year over year in 2027, while supply grows only 18.8%. In 2028, it sees demand up roughly 35% against supply growth of about 22%. The gap between demand and supply doesn't close. It widens.

Server DRAM is the key driver. Citi estimates server DRAM demand, measured on a 1Gb-equivalent basis, will rise from 226.3 billion units in 2026 to 341.7 billion units in 2027, an increase of about 51%. By that math, servers would account for roughly 67% of total DRAM demand.

The price outlook is equally aggressive. Citi estimates blended DRAM ASP will rise 242.4% year over year in 2026, with another 23.1% increase in 2027. That 242.4% figure is Citi's own blended ASP estimate, not a claim that every DRAM product's spot price triples uniformly. It shouldn't be read that way.

Why continual learning consumes so much more memory

Most generative AI today works by pretraining a large model, then answering user requests through inference. Models get updated periodically, but they aren't constantly folding new knowledge into their parameters in real time.

Continual learning goes a step further. AI would need to keep absorbing new tasks and new information, updating its performance without losing what it already learned.

That creates demand for memory on three fronts at once:

  • HBM - ultra-fast data supply for new training, retraining and large-scale inference
  • Server DDR5 - holding model state, data preprocessing and agent task state around CPUs and accelerators
  • Enterprise SSDs - storing and retrieving past knowledge, vector data, KV cache and state for large numbers of individual users

Put simply, if today's AI resembles a student who has finished studying for an exam, continual learning AI looks more like an employee who reads new material every day on the job, remembers past notes, and pulls them back up for the next task. It's not just the compute load that grows. The sheer volume of memory needed grows too.

Trimming HBM doesn't make memory demand disappear

One of the more interesting parts of Citi's report is how it reads the recent debate over HBM "de-spec." Some AI accelerator designs are lowering HBM capacity or offloading part of the KV cache to external storage, which some have read as a sign of cooling memory demand.

Citi's read runs the other way. Because HBM is scarce and expensive, system designers are shifting some data to server DRAM or high-capacity enterprise SSDs. That doesn't shrink memory demand. It spreads it across other layers.

If KV cache offloading expands further, high-capacity QLC-based enterprise SSDs stand to benefit. On the NAND side, Citi projects 2027 demand growth of 29% against supply growth of 21%, and 2028 demand growth of 33% against supply growth of 25%. That implies a supply shortfall of roughly 6.1% in 2027 and 5.5% in 2028.

This matters. It's getting harder to define AI memory investment as just an HBM story. When system design changes, demand doesn't vanish, it can migrate from HBM to DDR5 and enterprise SSDs.

Why supply is moving so slowly

If demand is growing 30% to 60% a year, it might seem like memory makers just need to build more fabs. But supply is responding unusually slowly this cycle.

First, HBM eats into general-purpose DRAM capacity. HBM consumes more wafers and requires heavier back-end processing than standard DDR. The more HBM output rises, the less capacity remains for commodity DRAM.

Second, bit growth from process-node shrinks alone is harder to come by than in past cycles. Citi expects the DRAM industry's average wafer capacity to grow only about 8% in 2027.

Third, new fabs take years between announcement and production. Site selection, construction, equipment installation, yield ramp and customer qualification can take several years. A surge in capex doesn't turn into next-quarter supply.

The upshot: memory makers have to reallocate capacity while demand is surging, and that reallocation itself cuts into supply of other memory types.

Personal AI and Physical AI are the wildcards after 2028

Citi's 2031 outlook is aggressive in part because it assumes entirely new sources of demand emerge after 2028.

If Personal AI ends up remembering an individual's emails, documents, calendar, and years of past conversations and preferences, the storage and active memory needed per user grows well beyond today's levels.

If Physical AI spreads into robots, self-driving vehicles and industrial automation, AI systems would need to keep storing and processing sensor data not just in the cloud but in vehicles, factories and robots as well.

Citi's long-run scenario rests on the assumption that these two demand sources combine with continual learning. If that plays out, new fabs coming online in 2028 could see their added supply absorbed almost immediately by new demand.

The three memory makers now need a different lens

CompanyStrengthWhat to watch this cycle
SK HynixHBM leadership and leverage with AI customersHBM4/HBM4E yields, customer concentration, next-gen packaging capacity
Samsung ElectronicsLarge DRAM base plus combined HBM, foundry and packaging capacityHBM4 customer qualification, yields, improving AI DRAM mix
MicronExposure to the US AI supply chain across HBM, server DRAM and enterprise SSDsLong-term contracts, HBM4E transition, new fab capex and free cash flow

Beyond Samsung, SK Hynix and Micron, Citi also named SanDisk and Kioxia among its top memory picks. On the equipment and materials side, it flagged names including Applied Materials and Lam Research. Being named a "top pick" reflects Citi's own investment view. It is not a guarantee that any of these companies' valuations will actually rise.

Three scenarios make the picture clearer

Bull case: Continual learning, agentic AI, Personal AI and Physical AI spread quickly, and HBM, DDR5 and enterprise SSDs all fall short at once. New 2028 supply gets absorbed by demand as fast as it arrives.

Base case: 2027 is the tightest year, and supply growth eases somewhat starting in 2028-2029. High-value AI memory still holds stronger pricing power than commodity products.

Bear case: A slowdown in AI capex, delays in commercializing continual learning, and faster-than-expected ramp-ups at new fabs combine to normalize the supply shortage sooner than expected after 2028.

Insight Times Editorial Desk

More by topic

Starting with this story's topics, then what readers are following now

Investor psychology, decision-making and books on investing

HBM

This story's topic75 storiesSee all →

Memory stacked next to the GPU.

AI Chip Peak Check: Demand Still Rising, Risk Building in 2027-2029 Supply and Funding

DRAM and NAND contract prices are still climbing and HBM suppliers hold the edge. Power shortages, AI financing costs and simultaneous memory expansion are the risks for later years.

Investing

Has Memory Peaked? Prices Are Cooling, but the Shortage Looks Set to Run to 2028

Price growth has slowed and consumer demand is already breaking. Server and HBM supply remains short, and Micron says more than 75% of its 2027 volume is already committed to customers.

Tech

The Real ASML Number Isn't the 3% Pop, It's the 30% Capacity Hike

ASML's rally isn't just an AI trade. Customers are already locking in 2027 tool slots, and ASML is raising Low-NA EUV capacity by roughly 30% to keep up.

Investing

AI Chips Haven't Peaked. The Real Risk Sits in 2028 Supply

HBM and server DRAM shortages are now spreading into enterprise SSDs. The question isn't today's strength, it's how much new capacity these prices are pulling in and when it lands.

Investing

The Next AI Chip Race Is About How Chips Connect

Applied Materials will lift its stake in Dutch equipment maker BESI from about 9% to 20%. The bet is less about control than about a new way to link chips.

Tech

US AI Data Centers Are Headed for 90GW. Gigawatts Now Matter More Than Dollars

Goldman Sachs expects US data center capacity to grow from 64GW at the end of 2026 to 90GW at the end of 2027. The AI race is moving from buying GPUs to building power plants and transmission lines alongside them.

Tech

2027 Investing Needs Alignment, Not Prediction

A new investing book argues the hard part was never picking the next winner. It's staying aligned with where value and bottlenecks are moving while keeping old human weaknesses in check.

Investor Mind

A building that houses servers and networking gear and supplies them with powe…

Nvidia and Palantir Put AI Inside the Supply Chain - The Real Shift Is That It's Learning Judgment

A single Vera Rubin rack holds 1.3 million parts. The real breakthrough in Nvidia and Palantir's new supply chain AI isn't automating that complexity, it's capturing the judgment calls that used to live only in planners' heads.

Tech

Why the White House Swapped "AI" for "Super Intelligence"

Executive Order 14434 renames AI across the federal government without defining a new technology. The real story is about roughly $700 billion in capex, free cash flow and electricity.

Tech

AMD Crossed $1 Trillion, and the Market Started Looking at CPUs Again

AMD's stock topped a $1 trillion market cap for the first time. The rally isn't just about being an Nvidia alternative. It reflects a reassessment of AMD as a full-stack AI infrastructure vendor, one that bundles CPUs, GPUs and networking, as AI shifts from chatbots to agents and reignites data center demand for CPUs.</deck> <parameter name="oneline">As AI moves from chatbots to agents, the market has started counting the CPU sitting next to the GPU again.

Tech

Why Nebius Is Keeping Some 2027 AI Capacity Off the Shelf

Nebius mixes long-term contracts, short-term premiums and auctions. Holding back capacity pays only if the servers stay busy, and it is not yet clear the pricing will last.

Tech

DeepSeek's $15 Billion Raise: Model Makers May Feel It Before Nvidia Does

China's DeepSeek is closing a round about twice its original target. For US investors, the question is less the size of the check than where the money goes and whose profits it could erode.

Tech

AI Data Centers Are Rewriting Contracts While They Wait for Power

Oracle's Project Jupiter shows that the AI power shortage is no longer a "2030 forecast." The mere possibility of a delayed power hookup has already triggered a force majeure clause, and it is starting to shake billions in loans and lease-income timelines.

Tech

Nvidia's Next Target After GPUs: Controlling What AI Agents Are Allowed to Do

OpenShell and Sentry are not about policing what an AI says. They are about controlling, at the server infrastructure level, which files and APIs an AI can touch, what it can execute, and who can actually pull the plug when something goes wrong.

Tech

NVDA

92 storiesSee all →

Amazon Goes After Nvidia's Strongest Moat, and It Is Software, Not GPUs

Amazon's open-source TorchNeuron aims to let existing AI code run on its Trainium chips. The contest comes down to the total cost of AI compute and the return on Amazon's $220 billion in annual capital spending.

Tech

AI's Next Bottleneck Is Money, Not Chips

Broadcom is lending Anthropic up to $42 billion, and Nvidia wants to build a $500 billion market for loans backed by GPUs. The AI race may turn on what rate buyers pay to borrow.

Tech

Two Companies Drive 34% of S&P 500 Earnings Growth as AI Pays Sellers First

Nvidia and Micron generate a third of expected earnings growth in US large caps. Apollo says the financial effect of AI is not yet visible in the S&P 493.

Investing

China's AI Labs Went Open Source Because They Had to, Not Because They Wanted To

A GPU shortfall pushed Chinese AI labs toward efficiency and open weights, and that constraint is now reshaping the global competition over who controls AI's basic infrastructure.

Tech

The US-China Summit Didn't Erase Taiwan Risk for Chip Stocks

Washington's Taiwan policy held, but roughly $14 billion in arms sales is still on hold. For AI chip investors, the summit reads less like risk removed and more like a fragile balance extended.

Macro

ASML Is Discussing 2030 Orders. How Long Can the AI Chip Supercycle Last?

Despite bubble worries, ASML sees equipment shortages through 2028. Investors should watch future production capacity, not just today's orders.

Tech

Tesla Energy's 13.7GWh Paradox: Expectations Ran Faster Than Deployments

Q2 deployments recovered but margins collapsed. Q3 set a record for deployments and still missed estimates. The issue is not the size of AI power demand but how fast it converts into Tesla revenue and profit.

Tech

GPU

65 storiesSee all →

A chip built to draw graphics, whose ability to run thousands of identical cal…

Musk Borrowed $40 Billion for GPUs. He Also Warned AI Cloud Firms Could Go Bust

SpaceX's giant financing shows a new dividing line in AI: who borrows matters as much as how much is spent. Firms with other revenue may outlast those that rent out GPUs alone.

Tech

AI Stops Just Talking, Starts Working: The Second Infrastructure Cycle

The center of the AI race is shifting from chatbot performance to agents that finish real work. For investors, what matters is not model rankings but how a single query turns into dozens of inference calls, pulling demand beyond GPUs into CPUs, HBM, networking and power.

Tech

Why Nvidia Is Happy to Help Make AI Models Nearly Free

Falling model prices can squeeze model makers. For Nvidia, the number that matters is the total volume of tokens generated worldwide and the compute that produces them.

Tech

The Number That Matters More Than How Smart AI Gets

This week's AI models got stronger and cheaper at the same time. The chart long-term investors should watch isn't the weekly benchmark leader, it's the falling cost of finishing a task successfully.

Tech

AI Data Centers' Next Bottleneck: Getting Power From the Grid to the GPU

Securing a gigawatt of power does not mean a gigawatt reaches GPU compute. The next fight in AI infrastructure is happening inside the data center, over how little electricity gets wasted before it reaches the chip.

Tech

Nvidia's $1 Trillion Number: How Far Has the AI Infrastructure Supercycle Come

Nvidia now frames Blackwell and Rubin sales opportunity through 2027 at more than $1 trillion. The real story isn't how many more GPUs get sold, it's AI turning into a physical infrastructure buildout spanning chips, memory, networking, cooling and power grids.

Tech

The Cheaper Tokens Get, the Bigger Your AI Bill Gets

As AI shifts from training to inference, the token is becoming an industrial commodity. Falling prices are not cutting demand, because agents and automation consume tokens at a scale no human chat session ever did.

Investing