Storage, not GPUs, is the biggest challenge to AI says influential report — lack of bits and bytes is what could make or break your AI/ML project

a nvidia gpu chip
(Image credit: Shutterstock)

A major report on the state of the AI industry has revealed some key insights into potential problems for companies and the industry at large as its growth continues to boom following the release of ChatGPT and other AI models. 

S&P Global Market Intelligence, commissioned by WEKA, recently released its 2024 Global Trends in AI report, surveying over 1,500 different tech executives and decision-makers on underlying trends across a broad range of topics.

Some of the most interesting insights related to the supply of AI-capable GPUs, almost all of which are made by Nvidia, although companies like AMD, as well as start-ups, are gaining some ground. 

The main takeaway, as per WEKA, is that AI applications are "now pervasive in the enterprise", which is probably something most employees can feel already. However, scaling these AI apps is often tricky, mostly due to legacy data architectures. 

Generative AI has also taken organisations by storm, with the report noting 88% of organizations are "now actively investigating generative AI, far outstripping other AI applications such as prediction models (61%), classification (51%), expert systems (39%) and robotics (30%)." 

Nvidia, the corporate world needs you

A100

(Image credit: Nvidia)

High-end GPUs are, naturally, a big focus of the report – having the raw power is fundamental to being able to actually do anything with many AI applications. 

"Hyperscaler public clouds are one pathway to GPUs, but many are also turning to specialist AI clouds," it notes. "GPU clouds are emerging as a key venue for both training – employed by almost a third, 32% of organizations – and inference, 31%."

All of this interest means that orders for Nvidia chips are only getting bigger. 

Interesting, WEKA highlights the issue of GPU scarcity in a number of major Asia-Pacific economies, including India. "India, Taiwan, New Zealand, and Australia are more likely to rank GPU availability among their top three challenges to bringing a model into production," says the report authors. 

"One of the most striking takeaways from our 2024 Trends In AI study is the astonishing rate of change that’s taken place since the onset of ChatGPT 3 and the first wave of generative AI models reached the market in early 2023," principal research analyst John Abbott told Blocks & Files

"In less than two years, generative AI adoption has eclipsed all other AI applications in the enterprise, defining a new cohort of AI leaders and shaping an emergent market of specialty AI and GPU cloud providers."

MORE FROM TECHRADAR PRO

Max Slater-Robins has been writing about technology for nearly a decade at various outlets, covering the rise of the technology giants, trends in enterprise and SaaS companies, and much more besides. Originally from Suffolk, he currently lives in London and likes a good night out and walks in the countryside.

Read more
A person holding out their hand with a digital AI symbol.
AI smartphone and laptop sales are said to be slowly dying – but is anyone surprised?
Nvidia HQ
Nvidia calls DeepSeek an 'excellent AI advancement' and praises the Chinese AI app's ingenuity
A hand reaching out to touch a futuristic rendering of an AI processor.
DeepSeek and the race to surpass human intelligence
Nvidia H800 GPU
A look at the unbelievable Nvidia GPU that powers DeepSeek's AI global ambition
Nvidia GR00T N1 humanoid robot
Nvidia is dreaming of trillion-dollar datacentres with millions of GPUs and I can't wait to live in the Omniverse
Nvidia CEO Jensen Huang
Nvidia is preparing for the post-GPU AI era as it is reportedly recruits ASIC engineers to fend off competition from Broadcom and Marvell
Latest in Pro
Insecure network with several red platforms connected through glowing data lines and a black hat hacker symbol
Multiple H3C Magic routers hit by critical severity remote command injection, with no fix in sight
ai quantization
Shadow AI: the hidden risk of operational chaos
Digital clouds against a blue background.
Navigating the growing complexities of the cloud
Zendesk Relate 2025
Zendesk Relate 2025 - everything you need to know as the event unfolds
Microsoft
"Another pair of eyes" - Microsoft launches all-new Security Copilot Agents to give security teams the upper hand
Lock on Laptop Screen
Medusa ransomware is able to disable anti-malware tools, so be on your guard
Latest in News
ChatGPT Advanced Voice mode on a smartphone.
Talking to ChatGPT just got better, and you don’t need to pay to access the new functionality
Insecure network with several red platforms connected through glowing data lines and a black hat hacker symbol
Multiple H3C Magic routers hit by critical severity remote command injection, with no fix in sight
Apple Watch Ultra 2 timer
The Apple Watch is getting a sleep alarm upgrade it probably should have had 10 years ago
Nikon Z5
The Nikon Z5 II could land soon – here's what to expect from Nikon's rumored entry-level full-frame camera
Google Pixel Watch 3
Google Pixel Watches hit with delayed notifications, crashing, and performance issues following Wear OS 5.1 update
Zendesk Relate 2025
Zendesk Relate 2025 - everything you need to know as the event unfolds