← Can It Run? — GPU compatibility matrix · Local LLMs guide
Mistral Small 3 24B needs 14 GB VRAM at Q4. The RTX 3080 10GB has 10 GB.
🌀 Mistral Small 3 24B (Mistral) is a 24B-parameter model for fast general chat, low-latency assistants. Near-large-model quality with fast, efficient inference. The question is whether the RTX 3080 10GB’s 10 GB of VRAM can hold it — here’s the exact math.
VRAM requirements
| Quantization | VRAM needed | RTX 3080 10GB |
|---|---|---|
| Q4_K_M (recommended) | 14 GB | ❌ |
| Q8_0 (near-lossless) | 25 GB | ❌ |
Why it won’t fit (and what to do)
Mistral Small 3 24B needs 14 GB at Q4 but the RTX 3080 10GB has only 10 GB — you’re 4 GB short. You can offload layers to system RAM, but expect single-digit tokens/sec (painfully slow for chat).
About the RTX 3080 10GB
Architecture: Ampere · VRAM: 10 GB · Price: ~$400 used.
Good: Fast memory bandwidth, strong tokens/sec for its tier
Watch out: Only 10GB — awkward middle ground, limits model size
Check current RTX 3080 10GB price on Amazon →
Related checks
Other models on the RTX 3080 10GB
🎯 LLM Hardware Checker
Enter your exact GPU + RAM, see every model you can run.
💾 VRAM Requirements
Exact VRAM per model at Q4/Q5/Q8/FP16 with context scaling.
Frequently asked questions
Can the RTX 3080 10GB run Mistral Small 3 24B?
No — not enough VRAM without CPU offloading. Mistral Small 3 24B needs 14 GB VRAM at Q4_K_M; the RTX 3080 10GB has 10 GB.
How much VRAM does Mistral Small 3 24B need?
Mistral Small 3 24B needs about 14 GB at Q4_K_M (recommended) and 25 GB at Q8_0.
How many tokens per second will the RTX 3080 10GB get on Mistral Small 3 24B?
It won't fit in VRAM; with CPU offloading expect very slow single-digit tokens/sec.