Nvidia unleashes world's most powerful AI hardware yet

Nvidia Grace CPU Superchip
(Image credit: Nvidia)

Nvidia has unveiled its new Grace CPU Superchip designed for AI infrastructure and high performance computing at GTC 2022.

The new 144-core Arm Neoverse-based discrete data center CPU is actually comprised of two CPU chips connected over the company's high-speed, low-latency, chip-to-chip (C2C) interconnect, NVLink.

Nvidia's Grace CPU Superchip complements its Grace Hopper Superchip which was announced last year and features one CPU and one GPU, on one carrier board. While their makeup may be different, both superchips share the same underlying CPU architecture as well as NVLink-CNC interconnect.

Founder and CEO of Nvidia, Jensen Huang explained in a press release how the Grace CPU Superchip is ideal for AI workloads, saying:

“A new type of data center has emerged — AI factories that process and refine mountains of data to produce intelligence. The Grace CPU Superchip offers the highest performance, memory bandwidth and NVIDIA software platforms in one chip and will shine as the CPU of the world’s AI infrastructure.”

Nvidia H100

(Image credit: Nvidia)

Nvidia H100 and DGX H100

In an effort to power the next wave of AI data centers, Nvidia also announced its next-generation accelerated computing platform with Nvidia Hoppper architecture which succeeds the company's Nvidia Ampere architecture that launched two years ago.

The chipmaker even announced its first Hopper-based GPU which is packed with 80bn transistors. The Nvidia H100 is the world's largest and most powerful accelerator to date and like the Grace CPU Superchip, it also features NVLink interconnect for advancing gigantic AI language models, deep recommender systems, genomics and complex digital twins.

For enterprise businesses that want even more power, Nvidia's DGX H100 (its fourth-generation DGX system) features eight H100 GPUs and can deliver 32 petaflops of AI performance at new FP8 precision. This provides the scale to meet the massive compute requirements of large language models, recommender systems, healthcare research and climate science. It's worth noting that all of the GPUs in Nvidia's DGX H100 systems are connected by NVLink to provide 900GB/s connectivity.

The company's new Hopper architecture has already received broad industry support from leading cloud computing providers and Alibaba Cloud, AWS, Baidu AI Cloud, Google Cloud, Microsoft Azure, Oracle Cloud and Tencent Cloud all plan to offer H100-based instances. At the same time, Cisco, Dell Technologies, HPE, Inspur, Lenovo and other system manufacturers are planning to release servers with H100 accelerators.

Nvidia's H100 GPU is expected to be available worldwide later this year from cloud service providers, computer makers and directly from the company itself.

TOPICS
Anthony Spadafora

After working with the TechRadar Pro team for the last several years, Anthony is now the security and networking editor at Tom’s Guide where he covers everything from data breaches and ransomware gangs to the best way to cover your whole home or business with Wi-Fi. When not writing, you can find him tinkering with PCs and game consoles, managing cables and upgrading his smart home. 

Read more
A computer processing chip
Nvidia unveils GB200 NVL4 with two Grace CPUs and four Blackwell GPUs for modern data center workloads
Nvidia Project DIGITS
Nvidia brings Blackwell to your desk - Project DIGITS mini PC is more like a mini supercomputer
Project DIGITS - front view
I am thrilled by Nvidia’s cute petaflop mini PC wonder, and it’s time for Jensen’s law: it takes 100 months to get equal AI performance for 1/25th of the cost
Nvidia H800 GPU
A look at the unbelievable Nvidia GPU that powers DeepSeek's AI global ambition
Nvidia CEO Jensen Huang
Nvidia CEO Jensen Huang teases Blackwell Ultra reveal, along with "the one click after that"
Comino Grando H100 Server
AMD-powered, liquid cooled Comino Grando AI sever gets reviewed but I still can't see any octo Nvidia RTX 5090 GPUs configuration
Latest in Pro
Racks of servers inside a data center.
Modernizing data centers: an efficient path forward
Dr. Peter Zhou, President of Huawei Data Storage Product Line
Why AI commonization is so important for business intelligent transformation and what Huawei’s data storage has to offer
Wix automation
The world's leading website builder aims to save businesses time with new tool
Data Breach
Thousands of healthcare records exposed online, including private patient information
China
Juniper patches security flaws which could have let hackers take over your router
Hands typing on a keyboard surrounded by security icons
The psychology of scams: how cybercriminals are exploiting the human brain
Latest in News
Brad Pitt looks over his right shoulder with 'F1' written behind him
Apple Original Films will take you behind-the-scenes of a racing cockpit in this new thrilling F1 movie trailer
AI writer
Coding AI tells developer to write it himself
Reacher looking down at another character from the Prime Video TV series Reacher
Reacher season 3 becomes Prime Video’s biggest returning show thanks to Hollywood’s biggest heavyweight
Image showing detail of the Leica D-Lux 8
Still can't get a Fujifilm X100VI? This premium Leica compact costs less, and it's in stock
Man using iMessage on an iPhone
Apple will finally enable encrypted RCS messages between iOS and Android, and it's about time
Google Messages update
Google Messages could soon follow WhatsApp with an upgrade that makes it much easier to join group chats