This tiny box from Samsung can hold 2TB of a special kind of RAM worth tens of thousands of dollars — CXL Memory Module Box hailed as the future of expansive server memory in the age of AI

CXL Memory Module Box
(Image credit: Samsung)

At MemCon 2024, Samsung showcased its latest HBM3E technology, talked about its future HBM4 plans, and unveiled the CXL Memory Module Box, also known as CMM-B, the latest addition to its Compute Express Link (CXL) memory module portfolio.

CMM-B is essentially a memory pooling appliance for rack computing leveraging CXL. It supports disaggregated memory allocation, allowing memory capacity available in remote locations to be shared across multiple servers. Through this, CMM-B enables independent resource allocation in the rack cluster and allows for larger pools of memory to be assigned as needed. With up to 60GB/s bandwidth, Samsung says CMM-B is ideal for applications like AI, in-memory databases, and data analytics.

CMM-B can accommodate eight E3.S form factor CMM-D (PCIe Gen5) memory modules for a total of 2TB. CMM-D memory integrates Samsung's DRAM technology with the CXL open standard interface to deliver efficient, low-latency connectivity between the CPU and memory expansion devices.

Easy setup

Samsung says the CMM-B integrates seamlessly into Supermicro Plug and Play Rack Scale Solutions, ensuring not only faster productivity but also reduced total cost of ownership (TCO).

The CMM-B module comes pre-installed with Samsung’s Cognos Management Console (SCMC) software, which provides an intuitive interface for quick setup of the Rack-Scale server appliance. This software facilitates dynamic memory allocation, enabling memory to be allocated independently of the server to which it is attached.

During his keynote at MemCon, Jin-Hyeok Choi, Corporate Executive Vice President, Device Solutions Research America – Memory at Samsung Electronics said, “AI innovation cannot continue without memory technology innovation. As the market leader in memory, Samsung is proud to continue advancing innovation – from the industry’s most advanced CMM-B technology, to powerful memory solutions like HBM3E for high-performance computing and demanding AI applications. We are committed to collaborating with our partners and serving our customers to unlock the full potential of the AI era together.”

SuperMicro CMM-B

(Image credit: Samsung)

More from TechRadar Pro

TOPICS
Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
HBM vs HBF memory
A GPU or a CPU with 4TB HBM-class memory? Nope, you're not dreaming, Sandisk is working on such a monstrous product
Marvell cHBM benefits
A $100bn tech company you've probably never heard of is teaming up with the world's biggest memory manufacturers to produce supercharged HBM
Micron
Micron wants a bigger slice of the $100 billion HBM market with its 2026-bound HBM4 and HBM4E memory solutions
CAMM2 modules
CAMM2 memory modules promise significant advancements in memory technology with impressive read and write speeds
Sandisk 3D Matrix Memory
Sandisk's revolutionary new memory promises DRAM-like performance, 4X capacity at half the price
d-Matrix Corsair card
Tech startup proposes a novel way to tackle massive LLMs using the fastest memory available to mankind
Latest in Pro
Finger Presses Orange Button Domain Name Registration on Black Keyboard Background. Closeup View
I visited the world’s first registered .com domain – and you won’t believe what it’s offering today
Racks of servers inside a data center.
Modernizing data centers: an efficient path forward
Dr. Peter Zhou, President of Huawei Data Storage Product Line
Why AI commonization is so important for business intelligent transformation and what Huawei’s data storage has to offer
Wix automation
The world's leading website builder aims to save businesses time with new tool
Data Breach
Thousands of healthcare records exposed online, including private patient information
China
Juniper patches security flaws which could have let hackers take over your router
Latest in News
Google Pixel 8a in aloe green showing
Google Pixel 9a benchmark link teases the performance of the upcoming mid-ranger
Quordle on a smartphone held in a hand
Quordle hints and answers for Monday, March 17 (game #1148)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Monday, March 17 (game #379)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Monday, March 17 (game #645)
Apple iPhone 16 Pro HANDS ON
Leaked iPhone 17 dummy units may have given us our best look yet at all four models
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over