Nvidia’s next-generation Ampere A100 GPU available on Google Cloud

(Image credit: Nvidia)

Nvidia and Google has revealed a partnership to offer the Accelerator-Optimized VM (A2) instance family powered by Nvidia’s A100 compute GPU. 

The new A2 VM instance family is aimed at compute-intensive applications, including AI, data analytics, and scientific computing.

Introduced in mid-May, NVIDIA’s A100 accelerator features 6912 CUDA cores and is equipped with 40 GB of HBM2 memory offering up to 1.6 TB/s of memory bandwidth. The device provides up to 9.7 TFLOPS FP32 performance, up to 19.5 TFLOPS FP64 Tensor performance, and up 624 TOPs INT8 Tensor performance.

Nvidia A100

Google and Nvidia expect the new A100-based GPUs to boost training and inference computing performance by up 20 times over previous-generation processors.

(Image credit: Nvidia)

The Accelerator-Optimized VM (A2) instance family is available in alpha upon request and will be offered with different levels of performance for customers with various requirements. Those with demanding workloads requiring up to 312 TFLOPS of FP64 performance or up to 20 POPS of INT4 performance will be able to get the A2-megagpu-16G instance powered by 16 NVIDIA A100 GPUs interconnected using the NVSwitch with 640 GB of HBM2 memory, 96 vCPUs, and 1.3 TB of system memory. Those who do not need that much compute horsepower can get the A2-highgpu-1G instance powered by a single A100 accelerator and a 12-core Intel Cascade Lake vCPU.   

Public availability of Google’s A2 VMs is expected later this year. Google says that NVIDIA’s A100 GPU accelerators will be supported by the Google Kubernetes Engine (GKE), Cloud AI Platform, and other Google Cloud services shortly.

Google Cloud is the first cloud compute provider to offer Nvidia’s A100-powered services. The company uses NVIDIA’s HGX A100 servers designed in-house and built under supervision of the GPU company. 

Anton Shilov is the News Editor at AnandTech, Inc. For more than four years, he has been writing for magazines and websites such as AnandTech, TechRadar, Tom's Guide, Kit Guru, EE Times, Tech & Learning, EE Times Asia, Design & Reuse.

Latest in Pro
Finger Presses Orange Button Domain Name Registration on Black Keyboard Background. Closeup View
I visited the world’s first registered .com domain – and you won’t believe what it’s offering today
Racks of servers inside a data center.
Modernizing data centers: an efficient path forward
Dr. Peter Zhou, President of Huawei Data Storage Product Line
Why AI commonization is so important for business intelligent transformation and what Huawei’s data storage has to offer
Wix automation
The world's leading website builder aims to save businesses time with new tool
Data Breach
Thousands of healthcare records exposed online, including private patient information
China
Juniper patches security flaws which could have let hackers take over your router
Latest in News
Three iPhone 16 handsets on show
Apple could launch an iPhone 17 Ultra this year – but we've heard these rumors before
Super Mario Odyssey
ChatGPT is the ultimate gaming tool - here's 4 ways you can use AI to help with your next playthrough
Ray-Ban smart glasses with the Cpperni logo, an LED array, and a MacBook Air with M4 next to ecah other.
ICYMI: the week's 7 biggest tech stories from Twitter's massive outage to iRobot's impressive new Roombas
Brad Pitt looks over his right shoulder with 'F1' written behind him
Apple Original Films will take you behind-the-scenes of a racing cockpit in this new thrilling F1 movie trailer
AI writer
Coding AI tells developer to write it himself
Reacher looking down at another character from the Prime Video TV series Reacher
Reacher season 3 becomes Prime Video’s biggest returning show thanks to Hollywood’s biggest heavyweight