ChatGPT might bring about another GPU shortage - sooner than you might expect

ChatGPT
(Image credit: CHUAN CHUAN via Shutterstock)

Unless you live in a snug, deep cave, you’ll definitely have heard of ChatGPT. The AI-based text tool developed by the non-profit OpenAI has become prolific across the internet and foreshadows an explosion of AI development and mainstream use.

In order to create and maintain the huge databases of AI-analysed data that ChatGPT requires, the tool’s creators apparently used a staggering 10,000 Nvidia GPUs to train the AI to produce interesting and quirky responses. 

With the increasing popularity of AI, tech giants like Microsoft and Google are eager to integrate it into their own services. Forbes made an estimate as to how much it would cost to integrate AI into every single Google search, estimating the 4,102,568 Nvidia A100 GPUs needed would run the tech giant a whopping 100 billion dollars - paid to Nvidia, of course, which is a really hard number to wrap your head around even if it is just a guess on Forbes’ part.

The gamers among us will probably read this and sweat just a little, as it spells out bad news for the people that are looking to buy GPUs anytime soon. We may see a graphics card shortage akin to the recent one caused by high demand from crypto-mining, as companies will need plenty of GPUs to train AI cores to make the most of this newfound craze.

Analysis: Hello darkness, my old friend

This shortage scare will probably only affect Nvidia card sales since they have the most advanced AI cores on the market right now - however, that might change. Should other companies like AMD and Intel see the high demand and potential profit pool they may push harder to match Nvidia in the AI arena.

On the other hand, if Nvidia shifts more attention toward the AI sphere - and Team Green certainly wants to - it could leave an opening for AMD to fill up the gaming space for consumers. A shortage of Nvidia GPUs for gamers could push people towards AMD graphics cards.

Should the demand for GPUs in the future reach incredibly high levels the availability of those GPUs will suffer greatly for the average gamer. We won’t know just how far the demand could crawl and the number of GPUs that’ll be needed to train the AI models. 

As mentioned above, we already had to deal with a massive GPU shortage not too long ago thanks to miners and scalpers in the cryptocurrency space, which gives us an idea of what a fresh GPU shortage could look like. Crypto miners bought up as many GPUs as they could to mine currencies like Ethereum, and whatever stock wasn’t being used to mine was bought by scalpers who massively inflated the prices.

The shortage only eased up last year with the ‘crypto crash’ and Ethereum merge, and we're still seeing Nvidia graphics cards sell for far above MSRP. If Nvidia does commit to producing more GPUs for AI training purposes, expect graphics card prices to rise again.

TOPICS
Muskaan Saxena
Computing Staff Writer

Muskaan is TechRadar’s UK-based Computing writer. She has always been a passionate writer and has had her creative work published in several literary journals and magazines. Her debut into the writing world was a poem published in The Times of Zambia, on the subject of sunflowers and the insignificance of human existence in comparison. Growing up in Zambia, Muskaan was fascinated with technology, especially computers, and she's joined TechRadar to write about the latest GPUs, laptops and recently anything AI related. If you've got questions, moral concerns or just an interest in anything ChatGPT or general AI, you're in the right place. Muskaan also somehow managed to install a game on her work MacBook's Touch Bar, without the IT department finding out (yet).

Read more
A person holding out their hand with a digital AI symbol.
AI smartphone and laptop sales are said to be slowly dying – but is anyone surprised?
Nvidia HQ
Nvidia calls DeepSeek an 'excellent AI advancement' and praises the Chinese AI app's ingenuity
Nvidia H800 GPU
A look at the unbelievable Nvidia GPU that powers DeepSeek's AI global ambition
Nvidia CEO Jensen Huang
Nvidia is preparing for the post-GPU AI era as it is reportedly recruits ASIC engineers to fend off competition from Broadcom and Marvell
Nvidia GR00T N1 humanoid robot
Nvidia is dreaming of trillion-dollar datacentres with millions of GPUs and I can't wait to live in the Omniverse
A person's hand using DeepSeek on their mobile phone
'A virtual DPU within a GPU': Could clever hardware hack be behind DeepSeek's groundbreaking AI efficiency?
Latest in Artificial Intelligence
David Kampf #64 of the Toronto Maple Leafs warms-up before playing the Philadelphia Flyers at the Scotiabank Arena on March 25, 2025 in Toronto, Ontario, Canada.
ChatGPT and Gemini Deep Research helped me choose an NHL team to support, and now I'm obsessed with ice hockey
A robot painting, created by ChatGPT.
ChatGPT’s new AI image capabilities are genuinely amazing, but they’re so frustrating to use that it made me want to throw my laptop in the trash
Google Gemini 2.5 and ChatGPT o3-mini
I pitted Gemini 2.5 Pro against ChatGPT o3-mini to find out which AI reasoning model is best
Opera AI Tabs
Feel like your browser tabs are out of control? Opera's new AI tab-management tool will bring order to the chaos
Sama virtual assistant
Speak, Book, Fly. Qatar Airways debuts industry-first AI travel agent, Sama
Apple WWDC 2025 announced
3 things Apple needs to do at WWDC 2025 to save Apple Intelligence, and why I'm convinced it will
Latest in News
Nintendo Switch 2 Joy-Con up-close from app store
Nintendo's new app gave us another look at the Switch 2, and there's something different with the Joy-Con
cheap Nintendo Switch game deals sales
Nintendo didn't anticipate that Mario Kart 8 Deluxe was 'going to be the juggernaut' for the Nintendo Switch when it was ported to the console, according to former employees
Three angles of the Apple MacBook Air 15-inch M4 laptop above a desk
Apple MacBook Air 15-inch (M4) review roundup – should you buy Apple's new lightweight laptop?
Witchbrook
Witchbrook, the life-sim I've been waiting years for, finally has a release window and it's sooner than you think
Amazon Echo Smart Speaker
Amazon is experimenting with renaming Echo speakers to Alexa speakers, and it's about time
Shigeru Miyamoto presents Nintendo Today app
Nintendo Today smartphone app is out now on iOS and Android devices – and here's what it does