Get all your news in one place.
100’s of premium titles.
One app.
Start reading
TechRadar
TechRadar
Max Slater-Robins

Storage, not GPUs, is the biggest challenge to AI says influential report — lack of bits and bytes is what could make or break your AI/ML project

A nvidia gpu chip.

A major report on the state of the AI industry has revealed some key insights into potential problems for companies and the industry at large as its growth continues to boom following the release of ChatGPT and other AI models. 

WEKA, commissioned by S&P Global Market Intelligence, recently released its 2024 Global Trends in AI report, surveying over 1,500 different tech executives and decision-makers on underlying trends across a broad range of topics. 

Some of the most interesting insights related to the supply of AI-capable GPUs, almost all of which are made by Nvidia, although companies like AMD, as well as start-ups, are gaining some ground. 

The main takeaway, as per WEKA, is that AI applications are "now pervasive in the enterprise", which is probably something most employees can feel already. However, scaling these AI apps is often tricky, mostly due to legacy data architectures. 

Generative AI has also taken organisations by storm, with the report noting 88% of organizations are "now actively investigating generative AI, far outstripping other AI applications such as prediction models (61%), classification (51%), expert systems (39%) and robotics (30%)." 

Nvidia, the corporate world needs you

(Image credit: Nvidia)

High-end GPUs are, naturally, a big focus of the report – having the raw power is fundamental to being able to actually do anything with many AI applications. 

"Hyperscaler public clouds are one pathway to GPUs, but many are also turning to specialist AI clouds," it notes. "GPU clouds are emerging as a key venue for both training – employed by almost a third, 32% of organizations – and inference, 31%."

All of this interest means that orders for Nvidia chips are only getting bigger. 

Interesting, WEKA highlights the issue of GPU scarcity in a number of major Asia-Pacific economies, including India. "India, Taiwan, New Zealand, and Australia are more likely to rank GPU availability among their top three challenges to bringing a model into production," says the report authors. 

"One of the most striking takeaways from our 2024 Trends In AI study is the astonishing rate of change that’s taken place since the onset of ChatGPT 3 and the first wave of generative AI models reached the market in early 2023," principal research analyst John Abbott told Blocks & Files

"In less than two years, generative AI adoption has eclipsed all other AI applications in the enterprise, defining a new cohort of AI leaders and shaping an emergent market of specialty AI and GPU cloud providers."

MORE FROM TECHRADAR PRO

Sign up to read this article
Read news from 100’s of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.