Radeon RX 7900 XT
Radeon RX 7900 XT has 20 GB of VRAM at 800 GB/s — about 18.60 GiB usable after driver and compositor overhead. 1030 of 2118 indexed models fit at 128K context with f16 KV.
What fits at 128K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Qwen3.8-27B | UD-IQ2_M | 27.8B | 9.61 GiB | 8.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| dolphin-2.9.3-mistral-7B-32k | I1-IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-Instruct-v0.3-Parasite | I1-IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-Instruct-v0.3-Jbliterated | I1-IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-Instruct-v0.3 | IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mathstral-7B-v0.1 | IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-v0.3 | IQ1_M | 7.2B | 1.64 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| SciPhi-Self-RAG-Mistral-7B-32kKV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| dolphin-2.2.1-mistral-7bKV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| OpenChat-3.5-7B-Qwen-v2.0KV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| openchat-3.5-0106KV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-Instruct-v0.1KV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Mistral-7B-Instruct-v0.2 | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| ContextualKunoichi_KTO-7B | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| xLAM-7b-r | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Ninja-v1-RP-WIPKV unresolved | I1-IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| Kunoichi-DPO-v2-7BKV unresolved | IQ1_M | 7.2B | 1.63 GiB | 16.00 GiB | 18.57 GiB | 0.03 GiB | 28±26.5% |
| diffusiongemma-26B-A4B-it-HERETIC-UncensoredMoE | Q3_K_M | 25.8B | 12.38 GiB | 5.29 GiB | 18.56 GiB | 0.04 GiB | 28±26.5% |
| diffusiongemma-26B-A4B-itMoE | Q3_K_M | 25.8B | 12.38 GiB | 5.29 GiB | 18.56 GiB | 0.04 GiB | 28±26.5% |
| Qwen3.6-35B-A3B-REAM-160-ru-agentMoE | Q5_0 | 23.6B | 15.16 GiB | 2.50 GiB | 18.56 GiB | 0.04 GiB | 65±37% |
| Marco-Mini-InstructMoE | I1-IQ1_M | 17.3B | 3.69 GiB | 14.00 GiB | 18.56 GiB | 0.04 GiB | 20±37% |
| Qwen3.6-VL-REAP-26B-A3BMoE | Q4_K_M | 26.6B | 15.15 GiB | 2.50 GiB | 18.56 GiB | 0.04 GiB | 67±37% |
| Goetia-26B-A4B-v1.3-Absolute-Heretic-ARAMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Frank-26B-A4BMoE | I1-Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| G4-MeroMero-26B-A4B-it-uncensored-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| EVE-26b-XENO-HATMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Gemma-4-26B-A4B-Animus-V14.1-FFT-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-Claude-Opus-DistillMoE | Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliteratedMoE | I1-Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| G4-MeroMero-26B-A4BMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-Claude-Opus-Distill-v2MoE | Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| G4-Dark-Soul-26B-A4BMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-local-abliterated-sota-internal-t34MoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-SOMPOA-heresyMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-abliterixMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-heretic-ara-v2MoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Gemma-4-26B-A4B-it-heretic-antislopMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-ultra-uncensored-hereticMoE | Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-uncensored-hereticMoE | Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-Heretic-StableMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-Uncensored-MAXMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-ara-abliteratedMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Huihui-gemma-4-26B-A4B-it-abliteratedMoE | I1-Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Gemma-4-26B-A4B-AbliteratedMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma4-26b-fiction-bf16MoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-heretic-araMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-it-abliteratedMoE | Q3_K_M | 25.8B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4BMoE | Q3_K_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| GRM-2.6-Plus-0628 | IQ2_S | 27.8B | 9.59 GiB | 8.00 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| ThinkingCap-Qwen3.6-27B | IQ2_S | 27.4B | 9.59 GiB | 8.00 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Tess-4-27B | IQ2_S | 27.8B | 9.59 GiB | 8.00 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| gemma-4-26B-A4B-itMoE | IQ3_M | 26.5B | 12.37 GiB | 5.29 GiB | 18.55 GiB | 0.05 GiB | 28±26.5% |
| Voxtral-Mini-3B-2507 | Q5_K_S | 4.7B | 2.63 GiB | 15.00 GiB | 18.54 GiB | 0.06 GiB | 28±26.5% |
| starcoder2-15bKV unresolved | Q3_K_M | 16.0B | 7.54 GiB | 10.00 GiB | 18.54 GiB | 0.06 GiB | 28±26.5% |
| SuperGemma-4-12b-abliterated | I1-Q6_K | 12.0B | 9.11 GiB | 8.47 GiB | 18.53 GiB | 0.07 GiB | 28±26.5% |
| gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-uncensored-heretic | I1-Q6_K | 12.0B | 9.11 GiB | 8.47 GiB | 18.53 GiB | 0.07 GiB | 28±26.5% |
| gemma-4-12B-coder-fable5-composer2.5-v1-uncensored-heretic | I1-Q6_K | 12.0B | 9.11 GiB | 8.47 GiB | 18.53 GiB | 0.07 GiB | 28±26.5% |
| gemma-4-12B-it-uncensored-heretic | I1-Q6_K | 12.0B | 9.11 GiB | 8.47 GiB | 18.53 GiB | 0.07 GiB | 28±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 11.45 it/s | 7.75–16.22 | 328 |
| Prompt processing | 3219.16 tok/s | 2738.95–3754.68 | 63 |
| Text generation | 101.20 tok/s | 99.80–107.45 | 39 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 7900 XT run?
- 1030 of 2118 indexed open-weight models fit a Radeon RX 7900 XT at 131,072 context with f16 KV cache, the largest being Qwen3.8-27B at UD-IQ2_M. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 7900 XT actually have?
- Its nameplate is 20 GB, but about 18.60 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 7900 XT fast for local AI?
- Its memory bandwidth is 800 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.