Micron's data center MRDIMMs double the bandwidth of existing DDR5 DIMMs — promise enhanced AI and HPC performance with Xeon 6 Granite Rapid CPUs

Micron MRDIMM
(Image credit: Micron)

Micron has confirmed starting its new multiplexed rank dual inline memory module (MRDIMM). The new memory is designed for scenarios requiring more than 128GB of memory per DIMM slot and works by combining several layers of memory modules, running at standard DDR5 speeds, with a data buffer that speeds up the connection to the host computer, allowing for faster data transfers. 

MRDIMMs improve upon traditional TSV RDIMMs by offering increased bandwidth, greater capacity, reduced latency, and enhanced performance per watt.

Designed for use in virtualized environments, HPC, and AI data center operations, the MRDIMMs are the first generation in Micron's new memory module family and are compatible with Intel's new  Xeon 6 processors.

Used in Granite Rapids

“Micron’s latest innovative main memory solution, MRDIMM, delivers the much-needed bandwidth and capacity at lower latency to scale AI inference and HPC applications on next-generation server platforms," says Praveen Vaidyanathan, Vice President and General Manager of Micron’s Compute Products Group.

"MRDIMMs significantly lower the amount of energy used per task while offering the same reliability, availability and serviceability capabilities and interface as RDIMMs, thus providing customers a flexible solution that scales performance. Micron’s close industry collaborations ensure seamless integration into existing server infrastructures and smooth transitions to future compute platforms.”

Adhering to DDR5 physical and electrical standards, MRDIMM technology is intended to allow for better scalability of bandwidth and capacity per core. The modules offer up to a 39% increase in effective memory bandwidth, more than 15% improvement in bus efficiency, and up to 40% reductions in latency, compared to RDIMMs.

Available in capacities from 32GB to 256GB and suitable for both standard and tall form factors, MRDIMMs are tailored for 1U and 2U high-performance servers. Micron says they feature an advanced thermal design that lowers DRAM temperatures by up to 20 degrees Celsius, which helps improve cooling efficiency and reduces overall energy consumption for memory-intensive tasks.

Micron plans to begin volume shipping of MRDIMMs in the second half of 2024, timed to coincide with Intel’s launch of its 128 P-core Granite Rapids-AP line, a move which will see the chip giant take the fastest CPU server spot from AMD for the first time in a decade. Granite Rapids will be the first platform to support MRDIMMs at 8800MT/s on the host side.

More from TechRadar Pro

Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
Micron SOCAMM memory module
World's biggest RAM vendors develop superior memory form factor exclusively for Nvidia, sorry Intel and AMD
Micron
Micron wants a bigger slice of the $100 billion HBM market with its 2026-bound HBM4 and HBM4E memory solutions
Sandisk 3D Matrix Memory
Sandisk's revolutionary new memory promises DRAM-like performance, 4X capacity at half the price
Pure Storage DFM
150TB SSD modules to go mainstream in 2025, and Micron is getting a slice of that pie
d-Matrix Corsair card
Tech startup proposes a novel way to tackle massive LLMs using the fastest memory available to mankind
HBM vs HBF memory
A GPU or a CPU with 4TB HBM-class memory? Nope, you're not dreaming, Sandisk is working on such a monstrous product
Latest in Pro
An image of network security icons for a network encircling a digital blue earth.
Why multi-CDNs are going to shake up 2025
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
URL phishing
HaveIBeenPwned owner suffers phishing attack that stole his Mailchimp mailing list
Ransomware
Cl0p resurgence drives ransomware attacks to new highs in 2025
Millwall FC The Den
The UK's first football club mobile network is here - but you probably won't guess which team has launched it
Google Chrome
Google Chrome security flaw could have let hackers spy on all your online habits
Latest in News
Xbox Series X and Xbox wireless controller set to a green background
Xbox Insiders are currently testing a new Game Hub feature that looks useful, but I've got mixed feelings about it
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
Microsoft Surface Laptop and Surface Pro devices on a table.
Hate Windows 11’s search? Microsoft is fixing it with AI, and that almost makes me want to buy a Copilot+ PC
Oura Ring 4
Activity tracking on Oura Ring is about to get a whole lot better, but I've got bad news about your step count
Google Pixel Buds Pro 2
Cleaned your Pixel Buds Pro 2 recently? If not, you might be getting worse sound
Google Maps on a phone being held in someone's hand
Google Maps is getting two key upgrades, for easier route planning and quicker access to Gemini AI