Samsung's new HBM3E memory technology hits 1.2TB/s — you can bet that it will power Nvidia's next AI monster GPU, the GH200

Samsung’s latest memory technology has hit staggering speeds of 9.8Gb/s – or 1.2TB/s – meaning it’s more than 50% faster than its predecessor. 

The HBM3E memory standard, nicknamed Shinebolt, is the latest in a series of high-performance memory units Samsung has developed for the age of cloud computing and increased demand for resources.

Shinebolt is a successor to Icebolt, which comes in varieties up to 32GB, can reach speeds of up to 6.4Gb/s. These chips were designed specifically to be used with the best GPUs out there in AI processing and LLMs, with the firm ramping up production this year as the emerging industry gathers momentum.

Powering the next generation of AI chips

HBM3E will inevitably find its way into the components developed by the likes of Nvidia, with every suggestion it can find its way into the GH200, nicknamed Grace Hopper, in light of a recent deal it struck.

High-bandwidth memory (HBM) is much faster and more energy efficient than conventional RAM, and uses 3D stacking technology which lets the layers of chips to be stacked on top of each other.

Samsung’s HBM3E stacks layers higher than in previous iterations through the use of non-conductive film (NCF) technology, which eliminates gaps between the layers in the chips. Thermal conductivity is maximized, and it can ultimately hit much higher speeds and efficiency as a result. 

The unit will power the next generation of AI applications, Samsung claims, as it’ll speed up AI training and inference in data centers and improve the total cost of ownership (TCO). 

Even more exciting is the prospect that it’ll be included in Nvidia’s next-gen AI chip, the H200. The two companies struck an agreement in September in which Samsung would supply the chipmaker with HBM3 memory units, according to the Korea Economic Daily, with Samsung set to supply roughly 30% of Nvidia’s memory by 2024. 

Should this partnership continue, there’s every possibility HBM3E components will become part of this deal once they enter mass production. 

More from TechRadar Pro

TOPICS
Keumars Afifi-Sabet
Channel Editor (Technology), Live Science

Keumars Afifi-Sabet is the Technology Editor for Live Science. He has written for a variety of publications including ITPro, The Week Digital and ComputerActive. He has worked as a technology journalist for more than five years, having previously held the role of features editor with ITPro. In his previous role, he oversaw the commissioning and publishing of long form in areas including AI, cyber security, cloud computing and digital transformation.

Read more
HBM vs HBF memory
A GPU or a CPU with 4TB HBM-class memory? Nope, you're not dreaming, Sandisk is working on such a monstrous product
Micron
Micron wants a bigger slice of the $100 billion HBM market with its 2026-bound HBM4 and HBM4E memory solutions
Samsung 36GB HBM3E 12H DRAM
Samsung HBM roadmap shows Google could become Nvidia's fiercest competitor in AI by 2026, but I wonder what's happening to Microsoft
Tesla Autopark
Tesla emerges as surprising rival to AMD and Nvidia in quest to grab next-gen HBM4 memory for AI and supercomputers
Sandisk 3D Matrix Memory
Sandisk's revolutionary new memory promises DRAM-like performance, 4X capacity at half the price
AMD instinct
AMD fast-tracks its most powerful AI GPU ever as it seeks to steal market sharefrom Nvidia's Blackwell B100 and B200
Latest in Pro
An image of network security icons for a network encircling a digital blue earth.
Why multi-CDNs are going to shake up 2025
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
URL phishing
HaveIBeenPwned owner suffers phishing attack that stole his Mailchimp mailing list
Ransomware
Cl0p resurgence drives ransomware attacks to new highs in 2025
Millwall FC The Den
The UK's first football club mobile network is here - but you probably won't guess which team has launched it
Google Chrome
Google Chrome security flaw could have let hackers spy on all your online habits
Latest in News
A young woman is working on a laptop in a relaxed office space.
I’ll admit, Microsoft’s new Windows 11 update surprised me with its usefulness, providing accessibility fixes, a gamepad keyboard layout, and PC spec cards
inZOI promotional material.
inZOI has become the most wishlisted game on Steam, but I wouldn't get too caught up in the hype
Xbox Series X and Xbox wireless controller set to a green background
Xbox Insiders are currently testing a new Game Hub feature that looks useful, but I've got mixed feelings about it
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
Nespresso Vertuo Pop machine in Candy Pink with coffee drinks and capsules
My favorite Nespresso coffee maker just got a fresh new makeover, and now I love it even more
Microsoft Surface Laptop and Surface Pro devices on a table.
Hate Windows 11’s search? Microsoft is fixing it with AI, and that almost makes me want to buy a Copilot+ PC