Amazon unveils next-generation Graviton4 and Trainium2 chips to power the business AI future

AWS Graviton4 and Trainium2
(Image credit: AWS)

AWS has reaffirmed its intentions to be one of the world’s major hardware providers with the launch of its most powerful and efficient chips today.

The new Graviton4 and Trainium2 chips, unveiled at its AWS re:Invent 2023 event by CEO Adam Selipsky are designed to power the next generation of AI and machine learning models, offering more performance and efficiency than ever before.

“Silicon underpins every customer workload, making it a critical area of innovation for AWS,” said David Brown, vice president of Compute and Networking at AWS. “By focusing our chip designs on real workloads that matter to customers, we’re able to deliver the most advanced cloud infrastructure to them.

AWS Graviton4 and Trainium2

AWS is promising a major step up for Graviton4, claiming it provides up to 30% better compute performance, 50% more cores, and 75% more memory bandwidth than the current generation Graviton3 processors.

The company says that as they experiment and deploy more and more AI-powered workloads, customers are seeing their compute, memory, storage, and networking requirements increase, so need higher performance and larger instance sizes, all at an affordable cost and energy efficiency level to lessen any effects on the environment.

AWS is making Graviton4 available in Amazon EC2 R8g instances that it says offer larger instance sizes with up to three times more vCPUs and three times more memory than current generation, allowing customers to process larger amounts of data, scale their workloads, improve time-to-results, and lower their total cost of ownership.

Following its original launch in 2020, the second-generation Trainium2 looks to offer faster and more efficient training for current and future AI models that are using bigger datasets than ever, with today’s most advanced FMs and LLMs boasting hundreds of billions to trillions of parameters.

AWS says Trainium2 will deliver up to four times faster training than the first generation hardware, along with offering three times more memory capacity and can improve energy efficiency up to two times.

It can be deployed in EC2 UltraClusters of up to 100,000 chips, making it possible to train foundation models and large language models in a fraction of the time previously taken, with the company giving the example of training a a 300-billion parameter LLM in weeks versus months.

More from TechRadar Pro

Mike Moore
Deputy Editor, TechRadar Pro

Mike Moore is Deputy Editor at TechRadar Pro. He has worked as a B2B and B2C tech journalist for nearly a decade, including at one of the UK's leading national newspapers and fellow Future title ITProPortal, and when he's not keeping track of all the latest enterprise and workplace trends, can most likely be found watching, following or taking part in some kind of sport.

Read more
Trillium TPU
You can now rent Google's most powerful AI chip: Trillium TPU underpins Gemini 2.0 and will put AMD and Nvidia on high alert
Cerebras WSE-3
DeepSeek on steroids: Cerebras embraces controversial Chinese ChatGPT rival and promises 57x faster inference speeds
Data center racks with cables and servers
AWS partners with Orbital Materials to boost carbon removal, cooling, and efficiency in data centers
Intel Core Ultra PCs
“No matter who you are, what you do, what form factor you choose” - how Intel is bringing AI advantage and unrivaled security to every industry and ecosystem
HPE Compute Scale-up Server 3200
HPE now allows customers to run its most powerful server on AWS but is it actually a good idea?
Representation of AI
These are the 10 hottest AI hardware companies to follow in 2025
Latest in Pro
An image of network security icons for a network encircling a digital blue earth.
Why multi-CDNs are going to shake up 2025
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
URL phishing
HaveIBeenPwned owner suffers phishing attack that stole his Mailchimp mailing list
Ransomware
Cl0p resurgence drives ransomware attacks to new highs in 2025
Millwall FC The Den
The UK's first football club mobile network is here - but you probably won't guess which team has launched it
Google Chrome
Google Chrome security flaw could have let hackers spy on all your online habits
Latest in News
inZOI promotional material.
inZOI has become the most wishlisted game on Steam, but I wouldn't get too caught up in the hype
Xbox Series X and Xbox wireless controller set to a green background
Xbox Insiders are currently testing a new Game Hub feature that looks useful, but I've got mixed feelings about it
A stylized depiction of a padlocked WiFi symbol sitting in the centre of an interlocking vault.
Broadcom warns of worrying security flaws affecting VMware tools
Microsoft Surface Laptop and Surface Pro devices on a table.
Hate Windows 11’s search? Microsoft is fixing it with AI, and that almost makes me want to buy a Copilot+ PC
Oura Ring 4
Activity tracking on Oura Ring is about to get a whole lot better, but I've got bad news about your step count
Google Pixel Buds Pro 2
Cleaned your Pixel Buds Pro 2 recently? If not, you might be getting worse sound