Get all your news in one place.
100's of premium titles.
One app.
Start reading
Tom’s Hardware
Tom’s Hardware
Technology
Aaron Klotz

AMD RDNA 3 professional GPUs with 48GB can beat Nvidia 24GB cards in AI — putting the 'Large' in LLM

AMD Nvidia X David McAfee Radeon
Radeon Pro W7900 Dual Slot.

AMD is swinging back at Nvidia with new DeepSeek benchmarks that claim its monster 48GB RDNA 3 GPUs can outperform Team Green's previous-generation RTX 4090.

David McAfee, AMD vice president and general manager of Ryzen CPUs and Radeon graphics, posted on X that the Radeon Pro W7900 and Pro W7800 48GB cards can outperform an RTX 4090 by up to 7.3x in DeepSeek R1.

McAfee shared a graph of the three GPUs benchmarked in several iterations of DeepSeek R1 using LM Studio 0.3.12 and Llama.cpp runtime 1.18. The DeepSeek R1 iterations consisted of Distill Qwen 32B 8-bit, Distill Llama 70B 4-bit, Distill Qwen 32B 8-bit, and Distill Llama 70B 4-bit. The former two were configured to output conversational prompts (with 20 tokens) and the latter summarization prompts (with 3017 tokens).

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
US Schools Record Nearly 12,000 Book Bans, the Highest Ever in a Single Year, as 'Jane Eyre' and 'Lessons in Chemistry' Join the List
PEN America reports nearly 12,000 book-ban instances in US schools, a record total, as Texas overtakes Florida and AI tools enter the removal process.
International Business Times UK
International Business Times UK
Alice Zaslavsky’s shortcut beetroot baked risotto – recipe
An unconventional technique makes this vibrant rice – finished with dill fronds – a lower-touch dinner for weeknights
The Guardian - AU
The Guardian - AU
Does your sleep tracker get it right? A Pittsburgh neuroscientist weighs in
On a typical night, I go to bed wearing a tracking watch on one wrist and another type of tracker on the other wrist. Then I compare their sleep findings while I drink my morning coffee.
The Conversation
The Conversation
There's A Reason Taxi Cabs Are Almost Always Yellow
Yellow taxis are easy to spot in traffic, but the color's history goes far beyond simple visibility.
Motor1
Motor1
How ‘technoference’ can disrupt parent-child connections
Have you ever been telling someone a story when their phone lights up, and their eyes flicker toward their device?
The Conversation
The Conversation
Holding Lightning by Emily Lordi review – an intimate portrait of Whitney Houston
An empathetic biography of the the singer recasts her tumultuous later career as a triumph of self-expression
The Guardian - UK
The Guardian - UK
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.
Download on the AppStore Get it on Google Play