This is what $1 billion worth of AI GPUs look like — Elon Musk publishes video tour of Cortex, X's AI training supercluster powered by Nvidia's now obsolete H100

Tesla's Cortex AI training supercluster
(Image credit: Elon Musk via X)

We love a good look inside a supercomputer, with one of our recent favorites being the glimpse Nvidia gave us of Eos, the ninth fastest supercomputer on the planet.

Now, Elon Musk has provided a peek at the massive AI supercluster, newly dubbed Cortex, being used by X (formerly Twitter).

The supercluster, currently under construction at Tesla’s Giga Texas plant, is set to house 70,000 AI servers, with an initial power and cooling requirement of 130 megawatts, scaling up to 500 megawatts by 2026.

Tesla's AI strategy

In the video, embedded below, Musk shows rows upon rows of server racks, potentially holding up to 2,000 GPU servers - just a fraction of the 50,000 Nvidia H100 GPUs and 20,000 Tesla hardware units expected to eventually populate Cortex. The video, although brief, offers a rare inside look at the infrastructure that will soon drive Tesla’s most ambitious AI projects.

Cortex is being developed to advance Tesla’s AI capabilities, particularly for training the Full Self-Driving (FSD) autopilot system used in its cars and the Optimus robot, an autonomous humanoid set for limited production in 2025. The supercluster's cooling system, featuring massive fans and Supermicro-provided liquid cooling, is designed to handle the extensive power demands, which, Tom's Hardware points out, is comparable to a large coal power plant.

Cortex is part of Musk's broader strategy to deploy several supercomputers, including the operational Memphis Supercluster, which is powered by 100,000 Nvidia H100 GPUs, and the upcoming $500 million Dojo supercomputer in Buffalo, New York.

Despite some delays in upgrading to Nvidia's latest Blackwell GPUs, Musk's aggressive acquisition of AI hardware shows how keen Tesla is to be at the forefront of AI development.

The divisive billionaire said earlier this year the company was planning to spend "over a billion dollars" on Nvidia and AMD hardware this year alone just to stay competitive in the AI space.

More from TechRadar Pro

Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
HPE
HPE may have beaten Supermicro and Dell to win a $1bn AI contract, but it's not for the Colossus supercomputer
Glowing server racks inside a data center.
xAI could sign a $5 billion deal with Dell for thousands of servers with Nvidia's GB200 Blackwell AI GPU accelerators
Nvidia GR00T N1 humanoid robot
Nvidia is dreaming of trillion-dollar datacentres with millions of GPUs and I can't wait to live in the Omniverse
Cerebras WSE-3
DeepSeek on steroids: Cerebras embraces controversial Chinese ChatGPT rival and promises 57x faster inference speeds
Tesla Autopark
Tesla emerges as surprising rival to AMD and Nvidia in quest to grab next-gen HBM4 memory for AI and supercomputers
A Corsair One i500 on a desk
Microsoft backed a tiny hardware startup that just launched its first AI processor that does inference without GPU or expensive HBM memory and a key Nvidia partner is collaborating with it
Latest in Pro
ai quantization
Shadow AI: the hidden risk of operational chaos
Digital clouds against a blue background.
Navigating the growing complexities of the cloud
Zendesk Relate 2025
Zendesk Relate 2025 - everything you need to know as the event unfolds
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand
Lock on Laptop Screen
Medusa ransomware is able to disable anti-malware tools, so be on your guard
AI quantization
What is AI quantization?
Latest in News
Apple Watch Ultra 2 timer
The Apple Watch is getting a sleep alarm upgrade it probably should have had 10 years ago
Nikon Z5
The Nikon Z5 II could land soon – here's what to expect from Nikon's rumored entry-level full-frame camera
Google Pixel Watch 3
Google Pixel Watches hit with delayed notifications, crashing, and performance issues following Wear OS 5.1 update
Zendesk Relate 2025
Zendesk Relate 2025 - everything you need to know as the event unfolds
Disney Plus logo with popcorn
You can finally tell Disney+ to stop bugging you about that terrible Marvel show you regret starting
Google Gemini AI
Gemini can now see your screen and judge your tabs