Want to have access to 96TB (yes Terabytes) of RAM? Check out this CXL expansion box that shows what the future of memory looks like

RAM in a PC motherboard
(Image credit: Shutterstock / Nor Gal)

Looking to beef up server capacity? The Inventec 96 DIMM CXL box could be what you’re looking for. Unveiled at OCP Summit 2024 alongside Astera Labs, the CXL expansion box allows users to connect up to 96 DDR5 DIMMS to a single server, providing enormous memory capacities ranging up to the tens of terabytes per memory server.

As reported by ServeTheHome, the expansion box can connect to the upcoming eight-way Intel Xeon 6 Granite Rapids-SP server, offering an even bigger punch.

Combined with the Intel Xeon 6 server, which boasts a total of 128 DDR DIMM slots, this means users could harness a massive 244 DIMM slots for a single server, providing significant memory capacity.

What you can expect from the 96 DIMM CXL expansion box

So what does this announcement mean exactly? Well, we’re talking about significant memory capacity boosts for servers.

The DDR5 DIMMS in question here are DDR5-4800, and the expansion box uses the Astera Labs Leo. Elsewhere, users are able to draw up 24 CDFP ports, each of which boasts a PCIe Gen5 x16 connection linking the CXL boat and the servers themselves.

As Servethehome noted, the launch shows users can draw upon a sizable 20TB of memory in a single server, which has massive long-term implications for server capacities and marks a huge development.

Underpinning all of this is the growing potential of compute express link (CXL) technology.

In 2023, Meta announced a partnership with AMD to showcase a memory type that can be added onto servers and capable of recycling petabytes worth of RAM.

As part of the collaboration, the two firms showed CXL can be used to markedly improve memory efficiency, in turn reducing costs and enhancing performance.

The demo board showcased by AMD and Meta included an AMD EPYC 9004 Genoa, boasted four dual in-line memory module (DIMM) slots, and a heat sink and fan.

Astera Labs’ involvement here marks the second major announcement from the semiconductor company so far this year. In April 2024, Astera Labs showcased its Aries 6 PCIe retimer board, which TechRadar Pro reported at the time could unlock significant benefits for hyperscalers ramping up AI development.

This retimer board can help maintain data signal integrity over the PCIe interface.

These high-speed data transfers typically suffer from degradation over long distances or due to interference.

The Aries 6 retimers marked the first in Astera Labs’ PCIe 6.x portfolio, and are aimed specifically at enhancing networking capabilities for next-generation GPUs, accelerators, CPUs, and CXL memory controllers.

More from TechRadar Pro

News and Analysis Editor, ITPro

Ross Kelly is News & Analysis Editor at ITPro, responsible for leading the brand's news output and in-depth reporting on the latest stories from across the business technology landscape.

Read more
HPE ProLiant Gen12 server
HPE launches slew of Xeon-based Proliant servers which claim to be impervious to quantum computing threats
Comino Grando H100 Server
AMD-powered, liquid cooled Comino Grando AI sever gets reviewed but I still can't see any octo Nvidia RTX 5090 GPUs configuration
BRIX GB-BRU7-255H
Gigabyte's mini PC is much smaller than the Apple Mac Mini M4 and should offer more storage for a lot less
Aemagic F3A mini PC
Another mini PC with a Ryzen AI 9 HX CPU has emerged, and not only does it support four 4K monitors, it can also take up to 96GB memory
HPE Compute Scale-up Server 3200
HPE now allows customers to run its most powerful server on AWS but is it actually a good idea?
Micron SOCAMM memory module
World's biggest RAM vendors develop superior memory form factor exclusively for Nvidia, sorry Intel and AMD
Latest in Pro
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand
Lock on Laptop Screen
Medusa ransomware is able to disable anti-malware tools, so be on your guard
AI quantization
What is AI quantization?
US flags
US government IT contracts set to be centralized in new Trump order
An abstract image of digital security.
Fake file converters are stealing info, pushing ransomware, FBI warns
Google Gemini AI
Gmail is adding a new Gemini AI tool to help smarten up your work emails
Latest in News
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand
Cassian Andor looking nervously over his shoulder in Andor season 2
New Andor season 2 trailer has got Star Wars fans asking the same question – and it includes an ominous call back to Rogue One's official teaser
Ncuti Gatwa as The Fifteenth Doctor in Doctor Who
Disney+ drops new trailer for Doctor Who season 2 that promises an epic adventure across time and space
23andMe
23andMe is bankrupt and about to sell your DNA, here's how to stop that from happening
A phone showing a ChatGPT app error message
ChatGPT was down for many – here's what happened
AirPods Max with USB-C in every color
Apple's AirPods Max with USB-C will get lossless audio in April, but you'll need to go wired