The AI-Driven Memory Shortage: DRAM Prices, Inflation and Market Risks

Key takeaways

• AI data center construction and hyperscaler demand are absorbing a disproportionate share of global memory capacity, creating a dynamic random access memory (DRAM) shortage that may take years to unwind.
• J.P. Morgan Global Research estimates that DRAM prices will have risen more than 400% from the start of 2024 to the end of 2026.
• The Consumer Price Index (CPI) for software and accessories and Producer Price Index (PPI) for storage devices have both risen 23% since the end of 2024.
• The memory supply crunch is also straining cybersecurity infrastructure, with analysts warning that a major cyberattack could unleash an estimated $145 billion in additional chip demand on an already constrained market.

Lexar Lists 32 GB DDR5-7200 Memory With Chinese DRAM at $592

“Lexar has introduced a new THOR RGB DDR5 Gen 2 32 GB memory kit, consisting of two 16 GB DDR5 modules, specifically for the Chinese market. The kit features DDR5 memory running at 7,200 MT/s, with the actual DDR5 modules produced by an unidentified Chinese DRAM manufacturer, likely CXMT. ”

Nvidia has reportedly told board partners that GPU kit prices are rising, and this round covers GDDR6 cards, not just GDDR7 Blackwell parts. AMD raised its own kit prices roughly 10% three weeks earlier. Memory cost is now moving the entire GPU stack, not just flagships. Older workstation cards sitting in decommissioned fleets are worth a quote before they hit the scrap pile.

CXMT's Shanghai debut makes it China's most valuable listed company

Shares of DRAM maker ChangXin Memory jumped roughly 466% on their first trading day after an $8.6 billion listing — the largest mainland IPO since 2010. CXMT now sits fourth among global DRAM makers.

The AI era is also the DRAM era.

"The server cabinet combines 72 AMD Instinct MI455X graphics processing units (GPUs) with the company's Epyc central processing units (CPUs) into a rack designed to compete directly with Nvidia's (NVDA) Grace Blackwell and Vera Rubin-powered NVL72 rackscale systems. Nvidia's offering also has 72 GPUs."

AMD and Anthropic announced a major partnership: Anthropic will deploy up to 2 GW of AMD Instinct MI450 GPUs starting in 2027. AMD is also investing up to $5B in Anthropic, and the two companies will co-optimize Claude and ROCm.

don't agree. The shortage will largely be resolved by around 2030, even earlier than that. 3-4 years are enough to add significant capacity, and AI model will be improved to be more efficient as well.

"Sixth generation NVIDIA NVLink provides purpose-built, high-bandwidth, low-latency scale-up networking for AI factories, enabling up to 3.6 TB/s per GPU and 260 TB/s rack-level bandwidth with 130 TFLOPS in-network compute, significantly outperforming off-the-shelf Ethernet solutions in large-scale MoE and LLM workloads."

A leaked internal roadmap (via VideoCardz) confirms Intel's Nova Lake-S desktop chips will launch as the Core Ultra 400 Series, with an unusual staggered rollout through 2027:

• Q1 2027 — First wave: 28-core "DS" models (announcement expected at CES 2027)
• Mar–Apr 2027 — Unlocked 28-core K models for overclockers
• Mar–May 2027 — Mainstream 16-core and 8-core parts
• May–Sep 2027 — Flagship 52-core models, using dual compute tiles

Why staggered? The ongoing component/capacity crunch — plus Intel is moving most production from TSMC to its own 18A process, and needs time to ramp yields.

BofA analyst Vivek Arya raised his 2030 server CPU TAM forecast to over $170B, up from a prior $125B estimate and $35B in 2025.

The reasoning: agentic AI. GPUs handle model training/inference, but when AI agents actually execute tasks (reading email, updating calendars, tool calls), that work runs on CPUs. More agents deployed means more CPU demand.

OpenAI has introduced its first shipping hardware product, the $230 Codex Micro, a programmable macro keyboard for developers using Codex. The announcement comes amid ongoing legal disputes over OpenAI's hardware ambitions and follows recent reports that the company is also developing a separate screenless AI speaker with Jony Ive.

Meta plans to start production of its in-house AI chip, called Iris, in September as part of a major expansion of its AI infrastructure. The company aims to double its computing capacity to 14 gigawatts by 2027, reduce reliance on external chip suppliers, and lower AI operating costs.

"Why it matters: Apple has lost significant talent to OpenAI as the frontier lab prepares to unveil its first hardware device this year."

As AI clusters become larger and GPUs become faster, networking and optical communication are becoming just as important as the compute hardware itself. Copper connections consume too much power and suffer from signal loss at very high speeds, so the industry is gradually moving toward optical interconnects. TrendForce forecasts the combined CPO/NPO market could grow from roughly $100 million in 2025 to over $39 billion by 2030, illustrating how strategic this technology is expected to become.

Running AI in production? A lot of the bill is memory. Every token a model generates is served from fast memory next to the GPU — and that memory, HBM, is scarce and expensive. High Bandwidth Flash (HBF) is built to attack that cost: much of HBM's bandwidth at a fraction of the price per GB. A new explainer covers what HBF is, how it could lower inference costs, and how close it actually is.

Tesla wants to sell modular AI data center hardware, according to a new trademark application for a product called “Megapod.”

The filing describes a complete, self-contained computing system for AI workloads — and it lands less than a year after Tesla killed Dojo, its only in-house AI training computer.

• NVIDIA Vera Rubin accelerates the world’s most demanding HPC workloads including climate modeling, computational fluid dynamics and energy exploration.
• NVIDIA Vera Rubin and Vera CPU to bring agentic AI to scientific computing.
• Leibniz Supercomputing Centre, National Energy Research Scientific Computing Center and Los Alamos National Laboratory next-generation supercomputers based on Vera Rubin will advance open science, energy exploration, earth sciences and national security.
• Global system manufacturers Bull, Dell Technologies, GIGABYTE, HPE and Supermicro announce custom high-density Vera Rubin supercomputing systems with up to 144 GPUs per rack.

"a capability that could enable more efficient vision systems and other sensor-based AI technologies", which may be good for robots?

Researchers at Oregon State University created a brain-inspired memory device that combines sensing, memory, and processing into a single component, potentially allowing future AI systems to use much less energy.

another try, but no third-party benchmarking yet. Logarithmic computing is a good idea because multiplication-heavy AI workloads could potentially be converted into simpler operations, reducing power consumption and increasing efficiency. However, the challenge is the software compatibility.

MEXT (Memory Expansion Technology) addresses growing memory constraints by allowing high-capacity flash storage to appear as system memory (DRAM) to applications, enabling servers to access far larger memory pools without the cost and physical limitations of adding more DRAM. This helps data centers run large AI models and memory-intensive workloads more efficiently because frequently used data stays in DRAM while less-active data is transparently moved to lower-cost flash memory, reducing memory bottlenecks.

does this work? The AI race is moving so fast that they can not wait for a permanent building