Radeon RX 6950 XT
Radeon RX 6950 XT has 16 GB of VRAM at 576 GB/s — about 14.88 GiB usable after driver and compositor overhead. 1687 of 2118 indexed models fit at 32K context with f16 KV.
What fits at 32K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Qwen2.5-14B | Q4_0 | 14.8B | 7.93 GiB | 6.00 GiB | 14.88 GiB | 0.00 GiB | 26±26.5% |
| GLM-4.7-Flash-DerestrictedMoE | I1-IQ3_M | 31.2B | 12.30 GiB | 1.65 GiB | 14.87 GiB | 0.01 GiB | 62±37% |
| Huihui-GLM-4.7-Flash-abliteratedMoE | I1-IQ3_M | 31.2B | 12.30 GiB | 1.65 GiB | 14.87 GiB | 0.01 GiB | 62±37% |
| GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-DistillMoE | IQ3_M | 31.2B | 12.30 GiB | 1.65 GiB | 14.87 GiB | 0.01 GiB | 62±37% |
| Kimi-Linear-48B-A3B-InstructMoE | IQ2_S | 49.1B | 13.01 GiB | 0.95 GiB | 14.87 GiB | 0.01 GiB | 26±26.5% |
| medgemma-27b-it | I1-IQ3_XS | 28.8B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| gemma-3-27b-it-abliterated-refined-vision | I1-IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| Nidum-Gemma-3-27B-it-Uncensored | I1-IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| gemma-3-27b-it-abliterated | IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| AtomicGPT-gemma3-27b | I1-IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| Unbound-v1.12.0-27B | I1-IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| Mira-v1.12-Ties-27B | I1-IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| gemma-3-27b-it | IQ3_XS | 27.4B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| Medgamma27B | I1-IQ3_XS | 27.0B | 10.77 GiB | 3.11 GiB | 14.86 GiB | 0.02 GiB | 26±26.5% |
| Pantheon-Reasoning-27B | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved | I1-IQ3_M | 27.4B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-Fable-5-Experimental | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwable-5-27B-Coder | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16 | IQ3_M | 27.4B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| EVE-27b-XENO-HAT-DeepSeek-V4-Flash | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| EVE-27B-XENO-HAT | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Godoter-27B | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Reasoning-Medical-27B | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwopus3.6-27B-v2-abliterated | I1-IQ3_M | 27.4B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-BF16 | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Reasoning-Medical0.1-27B | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Huihui-ThinkingCap-Qwen3.6-27B-abliterated | I1-IQ3_M | 27.4B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Semancer-27B | I1-IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3.6-27B-Omnimerge-v4 | IQ3_M | 27.8B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Darwin-28B-Coder | I1-IQ3_M | 26.9B | 11.89 GiB | 2.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Pantheon-Reasoning-26B-A4B-1.1MoE | Q3_K_M | 26.5B | 12.42 GiB | 1.54 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| NuExtract-1.5 | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Phi-3.5-mini-instruct | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Phi-3.5-mini-instruct_Uncensored | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Phi-3-mini-128k-instruct | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Phi-3-mini-4k-instruct | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| octo-net | Q3_K_L | 3.8B | 1.94 GiB | 12.00 GiB | 14.85 GiB | 0.03 GiB | 26±26.5% |
| Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-UncensoredMoE | I1-IQ2_S | 33.6B | 9.43 GiB | 4.50 GiB | 14.84 GiB | 0.04 GiB | 31±37% |
| Rocinante-XL-16B-v1 | IQ3_M | 16.1B | 7.14 GiB | 6.75 GiB | 14.84 GiB | 0.04 GiB | 26±26.5% |
| granite-20b-code-instruct-8k | Q5_K_L | 20.1B | 13.86 GiB | 0.00 GiB | 14.84 GiB | 0.04 GiB | 26±26.5% |
| Snowpiercer-15B-v4-heretic | I1-IQ4_XS | 15.0B | 7.64 GiB | 6.25 GiB | 14.83 GiB | 0.05 GiB | 26±26.5% |
| Snowpiercer-15B-v4 | IQ4_XS | 15.0B | 7.64 GiB | 6.25 GiB | 14.83 GiB | 0.05 GiB | 26±26.5% |
| Phi-3.5-mini-instruct | IQ4_XS | 3.8B | 1.92 GiB | 12.00 GiB | 14.82 GiB | 0.06 GiB | 26±26.5% |
| Qwen3.5-21B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking | I1-Q4_1 | 21.3B | 12.36 GiB | 1.50 GiB | 14.82 GiB | 0.06 GiB | 26±26.5% |
| Qwen3.6-21B-IQ-Ultra-Heretic-Uncensored-Thinking | I1-Q4_1 | 21.3B | 12.36 GiB | 1.50 GiB | 14.82 GiB | 0.06 GiB | 26±26.5% |
| granite-4.0-h-smallMoE | Q3_K_S | 32.2B | 13.43 GiB | 0.50 GiB | 14.81 GiB | 0.07 GiB | 63±37% |
| diffusiongemma-26B-A4B-it-HERETIC-UncensoredMoE | Q3_K_M | 25.8B | 12.38 GiB | 1.54 GiB | 14.81 GiB | 0.07 GiB | 26±26.5% |
| diffusiongemma-26B-A4B-itMoE | Q3_K_M | 25.8B | 12.38 GiB | 1.54 GiB | 14.81 GiB | 0.07 GiB | 26±26.5% |
| Goetia-26B-A4B-v1.3-Absolute-Heretic-ARAMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| Frank-26B-A4BMoE | I1-Q3_K_M | 26.5B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| G4-MeroMero-26B-A4B-it-uncensored-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| EVE-26b-XENO-HATMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| Gemma-4-26B-A4B-Animus-V14.1-FFT-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| gemma-4-26B-A4B-it-qat-q4_0-unquantized-hereticMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| gemma-4-26B-A4B-it-Claude-Opus-DistillMoE | Q3_K_M | 26.5B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliteratedMoE | I1-Q3_K_M | 26.5B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| G4-MeroMero-26B-A4BMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| gemma-4-26B-A4B-it-Claude-Opus-Distill-v2MoE | Q3_K_M | 26.5B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
| G4-Dark-Soul-26B-A4BMoE | I1-Q3_K_M | 25.8B | 12.37 GiB | 1.54 GiB | 14.80 GiB | 0.08 GiB | 26±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 6.56 it/s | 5.63–10.75 | 99 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6950 XT run?
- 1687 of 2118 indexed open-weight models fit a Radeon RX 6950 XT at 32,768 context with f16 KV cache, the largest being Qwen2.5-14B at Q4_0. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6950 XT actually have?
- Its nameplate is 16 GB, but about 14.88 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6950 XT fast for local AI?
- Its memory bandwidth is 576 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.