Intel bets on a secret weapon to beat AMD in some AI workloads — AVX-512 instructions will help Xeon beat Epyc in specific scenarios but Intel will have to work much, much harder to worry AMD

Intel
(Image credit: Intel)

Intel’s 5th-Gen Xeon Scalable processors, built on the Emerald Rapids architecture, can benefit from a huge raw performance boost when running AVX-512 workloads.

An Intel Xeon Platinum 8592+ CPU can almost double its average performance while also increasing power efficiency when running AVX-512 instructions in a handful of specific workloads, according to benchmarking site Phoronix

AVX-512 is an instruction set that increases the performance of a CPU by running the same instructions across different data points – known as single instruction multiple data (SIMD). 

Its main goal is to speed up data compression, cryptographic calculations and image processing tasks. It was criticized in the past due to poor power efficiency, however, and excessive heat generation. But recent generations of Intel Xeon CPUs don’t tend to display these side effects, rendering it a viable way to harness the full potential of the server-oriented processors.

Performance gain activated

Phoronix ran two 64-core Intel Xeon Platinum 8592+ CPUs on Ubuntu 23.10 with the Linux 6.5 kernel in the Intel Eagle Stream reference server. This system was fitted with 1TB DDR5 RAM as wel as a 3TB SSD.

In various benchmarks – including Embree, OpenVKL and Y-Cruncher – turning AVX-512 doubled the performance of the CPU. On the OpenVINO benchmark, in particular, enabling AVX-512 saw performance shoot up by up to more-than three times. 

OpenVINO is a toolkit Intel devised around neural networks; in particular, OpenVINO allows developers to quickly create applications for a variety of AI-centric tasks including emulating vision, speech recognition, and natural language processing. 

The CPU also experienced no major power usage or heat generation concerns, according to Phoronix, which highlighted the benefits of AVX-512 in today’s day and age, despite concerns when the tech first burst onto the scene.

Although Intel’s latest 5th-gen Xeon CPU may be one of the best processors for servers, based on raw performance it hasn’t hit the dizzying heights set by AMD’s 96-core counterpart – the Ryzen Threadripper Pro 7995WX. This CPU holds the world record in a number of categories, comfortably pipping anything Intel has to offer at the time of writing.

More from TechRadar Pro

TOPICS
Keumars Afifi-Sabet
Channel Editor (Technology), Live Science

Keumars Afifi-Sabet is the Technology Editor for Live Science. He has written for a variety of publications including ITPro, The Week Digital and ComputerActive. He has worked as a technology journalist for more than five years, having previously held the role of features editor with ITPro. In his previous role, he oversaw the commissioning and publishing of long form in areas including AI, cyber security, cloud computing and digital transformation.

Read more
Intel Xeon 6 P-cores
Intel Xeon 6 processors look to take the fight to Nvidia when it comes to powering your next data center and AI workloads
The Ryzen AI Max+ 395 could power the latest generation of powerful mini PCs
The AMD Ryzen AI Max+ 395 dominates as the "most powerful" APU on the market, but its competition is questionable
The socket interface of the Intel Core Ultra processor
Intel unveils its most powerful AI PCs yet - new Intel Core Ultra Series 2 processors pack in vPro for lightweight laptops and high-performance workstations alike
HPE ProLiant Gen12 server
HPE launches slew of Xeon-based Proliant servers which claim to be impervious to quantum computing threats
AMD Epyc 9965
The price of AMD’s most powerful processor ever has been slashed by almost half and I can't understand why
AMD Ryzen 9950X3D chip next to its packaging on a pink table
Asus' AI Cache Boost promises to "pump up" your AMD Ryzen 9000 processor's AI performance
Latest in Pro
FlexiSpot office furniture next to a TechRadar-branded badge that reads Big Savings.
Upgrade your home office for under $500 in the Amazon Spring Sale: My top picks and biggest savings
cybersecurity
Chinese government hackers allegedly spent years undetected in foreign phone networks
Data leak
A major Keenetic router data leak could put a million households at risk
Code Skull
Interpol operation arrests 300 suspects linked to African cybercrime rings
Insecure network with several red platforms connected through glowing data lines and a black hat hacker symbol
Multiple routers hit by new critical severity remote command injection vulnerability, with no fix in sight
An AI face in profile against a digital background.
Smarter, faster, better: how AI is elevating the customer experience industry
Latest in News
OpenAI logo
OpenAI just launched a free ChatGPT bible that will help you master the AI chatbot and Sora
Monster Hunter Wilds
Monster Hunter Wilds Title Update 1 launches in early April, adding new monsters and some of the best-looking armor sets I need to add to my collection
Zotac Gaming RTX 5090 Graphics Card
Nvidia Blackwell stock woes are compounded by price hikes as more RTX 5090 GPUs soar in pricing, and I’m sick and tired of it all at this point
A collage of Elizabeth Olsen's Scarlet Witch and Tatiana Maslany's She-Hulk
Marvel fans are already tired of Doomsday and Secret Wars cast gossip as two more superheroes get linked with roles in the next two Avengers movies
Four operators survey Verdansk. One holds a sniper rifle, one binoculars, another holds is landing with their parachute, while the last wears a skull mask
New Call of Duty: Warzone trailer shows a beautiful rebuilt Verdansk, but some fans want more: 'it won't be the same unfortunately'
An Apple Music pink/pixellated poster advertising DJ with Apple Music
DJ with Apple Music lands, allowing subscribers to build and mix DJ sets directly from its +100 million-song catalog