Samsung missed out on Nvidia's most expensive AI card but beats Micron to 36GB HBM3E memory — could this new tech power the B100, the successor of the H200?

Samsung 36GB HBM3E 12H DRAM
(Image credit: Samsung)

Samsung says it has developed the industry's first 12-stack HBM3E 12H DRAM, outpacing Micron Technology and potentially setting the stage for the next generation of Nvidia's AI cards. 

The South Korean tech giant's HBM3E 12H offers bandwidth of up to 1,280GB/s and an industry-leading capacity of 36GB, representing a more than 50% improvement over the 8-stack HBM3 8H.

The 12-stack HBM3E 12H uses advanced thermal compression non-conductive film (TC NCF), which allows the 12-layer products to meet the current HBM package requirements while maintaining the same height specification as 8-layer ones. These advancements have led to a 20% increase in vertical density compared to Samsung's HBM3 8H product.

The battle heats up

“The industry’s AI service providers are increasingly requiring HBM with higher capacity, and our new HBM3E 12H product has been designed to answer that need,” said Yongcheol Bae, Executive Vice President of Memory Product Planning at Samsung Electronics. “This new memory solution forms part of our drive toward developing core technologies for high-stack HBM and providing technological leadership for the high-capacity HBM market.”

Meanwhile, Micron has started mass production of its 24GB 8H HBM3E, which will be used in Nvidia's latest H200 Tensor Core GPUs. Micron claims its HBM3E consumes 30% less power than its competitors, making it ideal for generative AI applications. 

Despite missing out on Nvidia's most expensive AI card, Samsung's 36GB HBM3E 12H memory outperforms Micron's 24GB 8H HBM3E in terms of capacity and bandwidth. As AI applications continue to grow, Samsung's 12H HBM3E will be an obvious choice for future systems requiring more memory, such as Nvidia’s B100 Blackwell AI powerhouse which is expected to arrive by the end of this year. 

Samsung has already begun sampling its 36GB HBM3E 12H to customers, with mass production expected to start in the first half of this year. Micron is set to begin shipping its 24GB 8H HBM3E in the second quarter of 2024. The competition between the two tech giants in the HBM market is expected to intensify as the demand for high-capacity memory solutions continues to surge in the AI era.

More from TechRadar Pro

TOPICS
Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
Micron
Micron wants a bigger slice of the $100 billion HBM market with its 2026-bound HBM4 and HBM4E memory solutions
Samsung 36GB HBM3E 12H DRAM
Samsung HBM roadmap shows Google could become Nvidia's fiercest competitor in AI by 2026, but I wonder what's happening to Microsoft
HBM vs HBF memory
A GPU or a CPU with 4TB HBM-class memory? Nope, you're not dreaming, Sandisk is working on such a monstrous product
Tesla Autopark
Tesla emerges as surprising rival to AMD and Nvidia in quest to grab next-gen HBM4 memory for AI and supercomputers
Marvell cHBM benefits
A $100bn tech company you've probably never heard of is teaming up with the world's biggest memory manufacturers to produce supercharged HBM
ZUFS 4.0
Samsung's archrival becomes first chipmaker to launch 300+ layer TLC NAND flash memory; SK Hynix's 321-layer 1-terabit TLC paves the way for more affordable 100TB+ SSDs
Latest in Pro
Google DeepMind panel discussion
“More sovereignty and protection” - Google goes all-in on UK AI with data residency, upskilling projects, and startup investments
A graphic showing someone on a tablet working through a supply chain.
Security issue in open source software leaves businesses concerned for systems
European Union technical background
EU tech companies push for digital sovereignty, reducing reliance on US and others
ransomware avast
One of the most powerful ransomware hacks around has been cracked using some serious GPU power
person at a computer
Infamous ransomware hackers reveal new tool to brute-force VPNs
3D version of the Adobe logo
Adobe Summit 2025 - all the news and updates as it happens
Latest in News
Pebble smartwatch countdown
Pebble confirms its smartwatch announcement is just hours away
Google DeepMind panel discussion
“More sovereignty and protection” - Google goes all-in on UK AI with data residency, upskilling projects, and startup investments
Nintendo Switch 2
Nintendo Switch 2 expected to have AI upscaling and I can't wait to finally play Tears of the Kingdom with upgraded graphics
PowerColor Red Devil AMD RX 9070 XT graphics card shown side-on
Your next GPU could be from AMD, not Nvidia, if Team Red’s success with PC gamers continues
Intel Lunar Lake concept
Intel's Panther Lake processors won't arrive until Q1 2026 - corroborates previous delay rumors despite former Intel CEO's promise of 2025 launch
Quordle on a smartphone held in a hand
Quordle hints and answers for Tuesday, March 18 (game #1149)