Get all your news in one place.
100's of premium titles.
One app.
Start reading
TechRadar
TechRadar
Desire Athow

If you want to run AI training and inference on almost any GPU, then this startup may be the answer

A representative abstraction of artificial intelligence.

With the usage of AI in enterprises across the world continuing to boom, many organizations are hoping to get in on the action. But the technical, resource, and financial barriers to running a generative AI system like a large language model (LLM), let alone training one, remain prohibitively high for many companies.

The vast majority of businesses getting involved in training and managing generative AI models, however, will need to tap into the power of the best GPUs — and effectively replace their IT stack with graphics cards optimized for AI. Currently, Nvidia is the industry leader and manufactures several high-end GPUs. The Nvidia A100, for example, powers ChatGPT – while the follow-up GPUs including the H100 and H200 chips can run workloads even faster and more efficiently. 

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.