← Can It Run? — GPU compatibility matrix · Local LLMs guide
Qwen 2.5 72B needs 41 GB VRAM at Q4. The Radeon RX 7900 XTX 24GB has 24 GB.
🌐 Qwen 2.5 72B (Alibaba) is a 72B-parameter model for top-tier reasoning, code, and multilingual work. Flagship open model, competitive with the best 70B-class LLMs. The question is whether the Radeon RX 7900 XTX 24GB’s 24 GB of VRAM can hold it — here’s the exact math.
VRAM requirements
| Quantization | VRAM needed | Radeon RX 7900 XTX 24GB |
|---|---|---|
| Q4_K_M (recommended) | 41 GB | ❌ |
| Q8_0 (near-lossless) | 74 GB | ❌ |
Why it won’t fit (and what to do)
Qwen 2.5 72B needs 41 GB at Q4 but the Radeon RX 7900 XTX 24GB has only 24 GB — you’re 17 GB short. You can offload layers to system RAM, but expect single-digit tokens/sec (painfully slow for chat).
About the Radeon RX 7900 XTX 24GB
Architecture: RDNA 3 · VRAM: 24 GB · Price: ~$900.
Good: 24GB at a good price; works with llama.cpp + ROCm/Vulkan
Watch out: AMD software stack is less plug-and-play than CUDA
Check current Radeon RX 7900 XTX 24GB price on Amazon →
Related checks
Other models on the Radeon RX 7900 XTX 24GB
🎯 LLM Hardware Checker
Enter your exact GPU + RAM, see every model you can run.
💾 VRAM Requirements
Exact VRAM per model at Q4/Q5/Q8/FP16 with context scaling.
Frequently asked questions
Can the Radeon RX 7900 XTX 24GB run Qwen 2.5 72B?
No — not enough VRAM without CPU offloading. Qwen 2.5 72B needs 41 GB VRAM at Q4_K_M; the Radeon RX 7900 XTX 24GB has 24 GB.
How much VRAM does Qwen 2.5 72B need?
Qwen 2.5 72B needs about 41 GB at Q4_K_M (recommended) and 74 GB at Q8_0.
How many tokens per second will the Radeon RX 7900 XTX 24GB get on Qwen 2.5 72B?
It won't fit in VRAM; with CPU offloading expect very slow single-digit tokens/sec.