World’s largest chip gets beefier: 850 thousand cores for AI

(Image credit: Cerebras)

Cerebras Systems has announced its 2nd Generation Wafer Scale Engine processor in what looks to be a major breakthrough for the company.

Announed at the Hot Chips 2020 conference, the new chip — which is as large as a single 300-mm wafer — packs over two times more transistors as well as a whopping number of AI-optimized cores.  

The Cerebras Wafer Scale Engine Generation 2 has a die size of approximately 46,225 mm2 as it is limited by physical dimension of a 300-mm silicon wafer. The WSE 2 is processed using TSMC’s 7nm fabrication technology and consists of 2.6 million of transistors. To put the numbers into context, NVIDIA’s A100 measures 826mm2 and contains 54.2 billion transistors.

Incredible complexity

The Wafer Scale Engine 2 packs up to 850,000 proprietary cores specifically designed for processing AI/DL/ML applications. Each core has its own SRAM (i.e., there are tens of gigabytes of SRAM in every WSE) and all of them are interconnected using a special 3D mesh network that enables all 850,000 cores to work on the same task. 

(Image credit: Cerebras)

Cerebras claims that its Wafer Scale Engines are designed for workloads that would not perform good enough on traditional supercomputers employing hundreds of CPUs/GPUs/TPUs. Meanwhile, Wafer Scale Engines can be used with existing AI frameworks, such as TensorFlow or PyTorch, albeit with a special compiler from Cerebras. 

Cerebras says that it has already received its 2nd Generation Wafer Scale Engine from the fab and is currently testing it internally. There is no word on actual performance or even power consumption of the WSE 2, but the 1st Generation WSE consumes up to 20kW of power and is supplied as a 15U rack system.

(Image credit: Cerebras)

Sources: AnandTechTom’s Hardware

Anton Shilov is the News Editor at AnandTech, Inc. For more than four years, he has been writing for magazines and websites such as AnandTech, TechRadar, Tom's Guide, Kit Guru, EE Times, Tech & Learning, EE Times Asia, Design & Reuse.

Latest in Pro
Finger Presses Orange Button Domain Name Registration on Black Keyboard Background. Closeup View
I visited the world’s first registered .com domain – and you won’t believe what it’s offering today
Racks of servers inside a data center.
Modernizing data centers: an efficient path forward
Dr. Peter Zhou, President of Huawei Data Storage Product Line
Why AI commonization is so important for business intelligent transformation and what Huawei’s data storage has to offer
Wix automation
The world's leading website builder aims to save businesses time with new tool
Data Breach
Thousands of healthcare records exposed online, including private patient information
China
Juniper patches security flaws which could have let hackers take over your router
Latest in News
Google Pixel 8a in aloe green showing
Google Pixel 9a benchmark link teases the performance of the upcoming mid-ranger
Quordle on a smartphone held in a hand
Quordle hints and answers for Monday, March 17 (game #1148)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Monday, March 17 (game #379)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Monday, March 17 (game #645)
Apple iPhone 16 Pro HANDS ON
Leaked iPhone 17 dummy units may have given us our best look yet at all four models
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over