Top AI Models Converge at $2 per Million Tokens as Micron Margin Hits 87%

Google, OpenAI and Anthropic now price flagship models alike, while Micron reports an 87% non-GAAP gross margin. The scarce resource is shifting from tokens to memory, storage and power.

Flagship model price lists now point to the same number

Google unveiled Gemini 4 Argon on Sept. 30 at an introductory price of $2 per million input tokens and $10 for output. OpenAI's GPT-6 Sol and Anthropic's Claude Sonnet 5.5 carry the same price. Argon scored 77.9% on DeepSWE v1.1 and 51.3% on AutomationBench, both published by Google. This is hard to read as a discount on a weak model.

The broader trend points the same way. Epoch AI estimates the real cost of reaching a given level of performance has fallen about 47% per quarter since 2023, or roughly 13x a year. Silicon Data's broad LLM token spending index fell to $0.96 per million tokens as of Sept. 24. "Intelligence deflation" shows up in wide market data, not just in marketing copy.

MetricFigureNote
Frontier API$2 / $10Price per million input / output tokens
Epoch AIAbout 13x a yearEstimated annual decline in cost for equal performance
Silicon Data$0.96Broad-market spending index per million tokens, Sept. 24

Yet Micron's gross margin is 87%

Micron's fiscal fourth-quarter 2026 results, released the same day, sent the opposite price signal. Revenue reached $54.229 billion, up 379% from $11.315 billion a year earlier. Non-GAAP EPS was $33.42 and non-GAAP gross margin was 87.0%. Guidance for the next quarter calls for revenue of $61.5 billion, plus or minus $1.5 billion, non-GAAP EPS of $38.15, plus or minus $1, and non-GAAP gross margin of about 86.25%.

The contract numbers matter more. Micron's long-term strategic customer agreements rose to 26, with remaining contract value cited by the market at about $150 billion. Customer cash deposits and related financing commitments grew to $32 billion from $22 billion in June. In the past, volumes were renegotiated on short cycles. Some demand now appears to be locking into long-term contracts.

Concluding that "the memory cycle is gone" would go too far. An 87% gross margin is evidence of severe supply shortage. It also gives customers a stronger incentive to optimize harder and diversify suppliers. The longer high prices last, the more likely new supply and substitute technologies are to follow.

Workload elasticity matters more than Jevons

A halving of model prices does not automatically double infrastructure demand. The key is whether new workloads created by lower prices outrun gains in model efficiency and hardware performance. If they do, total compute and memory use rise.

Model price falls → more agent calls → longer context and repeated runs → more memory, storage and power demand

That is why agent-era economics is hard to explain with unit token prices alone. In work that repeats planning, search, tool calls and error correction, a pricier model that succeeds in fewer iterations can cost less in the end. Anthropic's description of Sonnet 5.5 as "up to 30% cheaper for most tasks" stresses cost per task rather than the API sticker price.

The next bottleneck is not only HBM

As long contexts and long-running agents spread, it gets harder to keep KV cache in GPU HBM alone. Inference infrastructure such as LMCache and Mooncake already supports tiering KV cache from GPU to CPU memory, local SSD and remote storage for reuse. In Mooncake's public benchmark, SSD offloading cut average time to first token by 57% and raised input throughput 2.4x versus GPU-only.

Micron's fiscal fourth-quarter materials also state that its PCIe Gen5 and Gen6 SSDs for KV-cache applications are shipping to major customers. That does not mean SSDs replace HBM. HBM stays the top tier for real-time compute, while cheap, high-capacity SSDs hold the caches and context that must persist.

TierMain resourceRoleWhat investors should watch
Tier 0GPU HBMReal-time attention, active tokensHBM capacity, bandwidth, packaging supply
Tier 1Host DRAM / CXLFast cache buffering and swapServer DRAM bit demand, CXL adoption
Tier 2Enterprise NVMe SSDRetaining and reusing large KV cacheQLC eSSD shipments, KV-cache SSD revenue
Physical layerPower, transmission, gas, landRunning the data centerPower timelines and project delays

A software price war meets hardware scarcity

Project Jupiter shows the last constraint is not only chips. Reuters reported that Oracle issued a force majeure notice over possible delays in securing power for its New Mexico data center. Oracle and STACK said the project is proceeding on its planned schedule. What is confirmed so far is that power and permitting can disrupt the financial timeline of a large AI project.

Opposing forces now operate at once in the AI value chain. Model makers must sell cheaper intelligence. Hyperscalers must handle more requests. Infrastructure suppliers try to keep prices high on limited memory and power. Where that balance breaks, the next investment opportunity and the next risk are likely to emerge together.

As AI intelligence gets cheaper, memory and power may become scarcer.

Insight Times Editorial Desk

More by topic

Starting with this story's topics, then what readers are following now

Investor psychology, decision-making and books on investing

HBM

This story's topic78 storiesSee all →

Memory stacked next to the GPU.

Memory Is Still Short, but Less Short: Checking for the Peak This Week

Citi trimmed its 2027 DRAM and NAND shortage forecasts together. Server pricing remains strong, while consumer markets show weakness. This week's numbers show where the memory boom may peak.

Investing

A 3x P/E is not a discount. It is a verdict on how long memory profits last

Nomura's buy case on Samsung Electronics and SK Hynix does not stop at higher memory prices. It argues that if AI has turned memory from a cyclical component into strategic infrastructure, the formula the market uses to value both companies has to change too.

Investing

AI ran out of memory before it ran out of GPUs

The HBM bottleneck is spreading into DRAM prices, server costs and the price of the next laptop or phone.

Tech

2027 Isn't the End: Citi's Case for a Memory Supercycle Running to 2031

Citi says the memory shortage timeline is stretching again. If AI shifts from "train once" models to continual learning, HBM, server DRAM and enterprise SSDs could all fall short at the same time.

Tech

Has Memory Peaked? Prices Are Cooling, but the Shortage Looks Set to Run to 2028

Price growth has slowed and consumer demand is already breaking. Server and HBM supply remains short, and Micron says more than 75% of its 2027 volume is already committed to customers.

Tech

AI Chip Peak Check: Demand Still Rising, Risk Building in 2027-2029 Supply and Funding

DRAM and NAND contract prices are still climbing and HBM suppliers hold the edge. Power shortages, AI financing costs and simultaneous memory expansion are the risks for later years.

Investing

The Real ASML Number Isn't the 3% Pop, It's the 30% Capacity Hike

ASML's rally isn't just an AI trade. Customers are already locking in 2027 tool slots, and ASML is raising Low-NA EUV capacity by roughly 30% to keep up.

Investing

A building that houses servers and networking gear and supplies them with powe…

Why Nebius Is Keeping Some 2027 AI Capacity Off the Shelf

Nebius mixes long-term contracts, short-term premiums and auctions. Holding back capacity pays only if the servers stay busy, and it is not yet clear the pricing will last.

Tech

Is Space Cooler for AI? Why Musk Wants Data Centers in Orbit

The next limit on AI may be power and cooling, not GPUs. Elon Musk is looking to Earth orbit for an answer, but the test is cost per hour of compute.

Tech

White House Swaps AI for "SI." The Real Investment Signal Is Infrastructure, Not the Name

An executive order renames artificial intelligence "Super Intelligence" and six frontier labs sign a voluntary safety accord. What investors should watch is the data center, power, nuclear and chip policy now gathered under one national-competitiveness frame.

Tech

Musk Sees the Next Phase of AI Infrastructure: Who Can Switch GPUs On, Fast

If neoclouds struggle under financial pressure, AI demand may not shrink. It may simply favor the few operators with the capital and execution to serve it, a shift that could matter for SpaceX and Tesla.

Tech

Weekly Check: The AI Bull Market Isn't Over, It's Just Gotten Harder

A 5% 10-year yield, 470 gigawatts stacked up in Texas, Chinese DRAM, and whether data centers actually get switched on are starting to decide who wins the AI trade through 2027.

Tech

Is Memory Peaking? In the AI Era, Watch the Bottleneck, Not the Demand

Demand still outruns supply. But memory stocks can peak before demand does. The real question is how long HBM4, server DRAM, CXL and Big Tech capex keep the cash flowing.

Tech

Marvell's $115 Billion Lumentum Deal: Is AI's Next Bottleneck Light, Not Chips?

Marvell's purchase of Lumentum points to a contest beyond GPU speed, in data transfer and power efficiency. Whether the price is right is not yet confirmed.

Tech

NVDA

101 storiesSee all →

Who Hits $1 Trillion Next: Reading AMD and ASML by Different Rules

One company is chasing Nvidia's GPU empire. The other sells the machine that draws the chips for every advanced chipmaker, including Nvidia. Both get floated as 2028 trillion-dollar candidates, but the numbers investors need to watch are entirely different.

Investing

Box Shows AI Its Manuals, and the AI Starts Redesigning the Workflow

Box Architect, built with NVIDIA, moves AI from reading documents to designing how work gets done. It has not yet reached beta, so the real-world payoff remains to be seen.

Tech

Tech Selloff: Is the Bull Market Over? Wall Street's Four-Year Chart Says Not Yet

The uptrend has survived five double-digit pullbacks in four years. This time, AI companies' debt and cash flow are the new variables.

Investing

Nvidia and Palantir Put AI Inside the Supply Chain - The Real Shift Is That It's Learning Judgment

A single Vera Rubin rack holds 1.3 million parts. The real breakthrough in Nvidia and Palantir's new supply chain AI isn't automating that complexity, it's capturing the judgment calls that used to live only in planners' heads.

Tech

If You Only Watch Tesla, You May Be Missing Half the AI Story

Nvidia builds the AI brain. Who supplies the electricity to run it? Six power companies Tesla investors should know, and why Tesla's storage business is just one link in the chain.

Investing

Nvidia Moves From GPUs to CPUs as AI Agents Reshape a $200 Billion Chip Market

A customer's early test found Nvidia's Vera CPU handled about twice the AI agent workload of its existing chips. The bigger story is where the money in semiconductors is heading as AI shifts from answering questions to doing work.

Tech

Nvidia's $500 Billion Experiment: Wall Street Asks Who Backs the GPU, Not Just the Chip

The real issue in Nvidia's financing platform is not chip sales. It is how far Wall Street will trust GPU resale prices and rental income three to four years out.

Tech

GPU

73 storiesSee all →

A chip built to draw graphics, whose ability to run thousands of identical cal…

The Next AI Chip Race Is About How Chips Connect

Applied Materials will lift its stake in Dutch equipment maker BESI from about 9% to 20%. The bet is less about control than about a new way to link chips.

Tech

US AI Data Centers Are Headed for 90GW. Gigawatts Now Matter More Than Dollars

Goldman Sachs expects US data center capacity to grow from 64GW at the end of 2026 to 90GW at the end of 2027. The AI race is moving from buying GPUs to building power plants and transmission lines alongside them.

Tech

The Cheaper Tokens Get, the Bigger Your AI Bill Gets

As AI shifts from training to inference, the token is becoming an industrial commodity. Falling prices are not cutting demand, because agents and automation consume tokens at a scale no human chat session ever did.

Investing

Dark navy cover. Flow diagram: Nvidia to Nscale (credit guarantee, in talks) to Anthropic (~$45B compute lease signed in August plus a separate ~$45B, ~460MW deal in talks). Title: Why Would Nvidia Back a Customer's Loan?

Why Would Nvidia Guarantee Its Customers' Data Center Loans?

Nvidia is reportedly in talks to back financing for Nscale's West Virginia data center. Nothing is signed, and the terms are not public.

Tech

Two Companies Drive 34% of S&P 500 Earnings Growth as AI Pays Sellers First

Nvidia and Micron generate a third of expected earnings growth in US large caps. Apollo says the financial effect of AI is not yet visible in the S&P 493.

Investing

Amazon Goes After Nvidia's Strongest Moat, and It Is Software, Not GPUs

Amazon's open-source TorchNeuron aims to let existing AI code run on its Trainium chips. The contest comes down to the total cost of AI compute and the return on Amazon's $220 billion in annual capital spending.

Tech

AI's Next Bottleneck Is Power, Not GPUs

Jensen Huang and Elon Musk sent the same warning in Washington. The AI race is widening from building better models to supplying power and chips at industrial scale.

Tech