Radeon RX 6600 XT
Radeon RX 6600 XT has 8 GB of VRAM at 256 GB/s — about 7.44 GiB usable after driver and compositor overhead. 1413 of 2118 indexed models fit at 4K context with q8_0 KV.
What fits at 4K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Ling-liteMoE | Q2_K | 16.8B | 6.43 GiB | 0.12 GiB | 7.44 GiB | 0.00 GiB | 79±37% |
| granite-4.1-8b | Q5_1 | 8.8B | 6.17 GiB | 0.33 GiB | 7.44 GiB | 0.00 GiB | 25±26.5% |
| Phi-4-reasoning | Q3_K_S | 14.7B | 6.06 GiB | 0.42 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Phi-4-reasoning-plus | Q3_K_S | 14.7B | 6.06 GiB | 0.42 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| phi-4 | Q3_K_S | 14.7B | 6.06 GiB | 0.42 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Falcon3-10B-Instruct | Q4_K_L | 10.3B | 6.13 GiB | 0.33 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it-vl-Gemini-3-Pro-Preview-Heretic-Uncensored-Thinking | I1-IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it-vl-Deepseek-v3.1-Heretic-Uncensored-Thinking | I1-IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it-vl-GLM-4.7-Flash-Heretic-Uncensored-Thinking | I1-IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Floppa-12B-Gemma3-Uncensored | I1-IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it-heretic | I1-IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it-abliterated | IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| gemma-3-12b-it | IQ4_XS | 12.2B | 6.10 GiB | 0.38 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| DeepCoder-14B-Preview | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| SuperNova-Medius | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Qwen2.5-Coder-14B-Instruct-abliterated | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| OpenCodeReasoning-Nemotron-14B | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| 0x-lite | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Qwen2.5-Coder-14B-Instruct | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Qwen2.5-14B-Instruct | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Qwen2.5-14B-Instruct-1M | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| Qwen2.5-Coder-14B | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| DeepSeek-R1-Distill-Qwen-14B | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| AceReason-Nemotron-14B | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| UwU-14B-Math-v0.2 | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| oxy-1-small | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| EVA-Qwen2.5-14B-v0.2 | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| EVA-Qwen2.5-14B-v0.0 | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| EVA-Qwen2.5-14B-v0.1 | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.43 GiB | 0.01 GiB | 25±26.5% |
| MythoMax-L2-13b | I1-IQ3_XXS | 13.0B | 4.82 GiB | 1.66 GiB | 7.42 GiB | 0.02 GiB | 25±26.5% |
| Lamarck-14B-v0.7 | Q2_K_L | 14.8B | 6.08 GiB | 0.40 GiB | 7.42 GiB | 0.02 GiB | 25±26.5% |
| NVIDIA-Nemotron-Nano-12B-v2 | Q3_K_L | 12.3B | 5.94 GiB | 0.51 GiB | 7.42 GiB | 0.02 GiB | 25±26.5% |
| Wan2.1-T2V-1.3B | Q4_0 | 1.4B | 6.50 GiB | 0.00 GiB | 7.42 GiB | 0.02 GiB | 25±26.5% |
| Rocinante-XL-16B-v1 | Q2_K | 16.1B | 6.02 GiB | 0.45 GiB | 7.42 GiB | 0.02 GiB | 25±26.5% |
| Qwen2.5-3B-Instruct-abliterated | Q8_0 | 3.1B | 6.43 GiB | 0.07 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| glm-4-9b-chat-1m | Q4_0 | 9.5B | 5.14 GiB | 1.33 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| GLM-4.7-Flash-DerestrictedMoE | I1-IQ1_M | 31.2B | 6.39 GiB | 0.11 GiB | 7.41 GiB | 0.03 GiB | 94±37% |
| Huihui-GLM-4.7-Flash-abliteratedMoE | I1-IQ1_M | 31.2B | 6.39 GiB | 0.11 GiB | 7.41 GiB | 0.03 GiB | 94±37% |
| granite-vision-4.1-4b | BF16 | 4.0B | 6.34 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| Parable-Granite-4.1-3B-Claude-Fable-5 | F16 | 3.4B | 6.34 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| granite-4.0-micro | BF16 | 3.4B | 6.34 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| granite-4.1-3b | BF16 | 3.4B | 6.34 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| granite-4.0-micro-base | BF16 | 3.4B | 6.34 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| dolphincoder-starcoder2-15bKV unresolved | I1-IQ3_XS | 16.0B | 6.25 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| starcoder2-15bKV unresolved | IQ3_XS | 16.0B | 6.25 GiB | 0.17 GiB | 7.41 GiB | 0.03 GiB | 25±26.5% |
| LFM2-24B-A2BMoE | IQ2_S | 23.8B | 6.45 GiB | 0.04 GiB | 7.41 GiB | 0.03 GiB | 100±37% |
| Apriel-1.6-15b-Thinker | I1-IQ3_S | 14.9B | 6.06 GiB | 0.40 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
| LFM2.5-Queen-Opus-4.7-8B-A1BMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| LFM2.5-8B-A1B-KO-SFTMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| LFM2.5-8B-A1B-hereticMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| LFM2.5-8B-A1B-SOMPOA-heresyMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| Huihui-LFM2.5-8B-A1B-abliteratedMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| Supertron2.1-8B-A1BMoE | I1-Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| LFM2.5-8B-A1BMoE | Q6_K | 8.5B | 6.48 GiB | 0.02 GiB | 7.40 GiB | 0.04 GiB | 72±37% |
| Phi-3-medium-128k-instruct | IQ3_M | 14.0B | 6.03 GiB | 0.42 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
| Phi-3-medium-4k-instruct | I1-IQ3_M | 14.0B | 6.03 GiB | 0.42 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
| glm-4-9b-chat | IQ4_NL | 9.4B | 5.13 GiB | 1.33 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
| GLM-4.7-Flash-REAP-23B-A3B-absolute-heresyMoE | I1-IQ2_XS | 23.0B | 6.38 GiB | 0.11 GiB | 7.40 GiB | 0.04 GiB | 84±37% |
| reka-flash-3.1 | I1-IQ1_S | 20.9B | 6.15 GiB | 0.27 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
| Gemma-4-12B-StyleTune | I1-Q3_K_M | 13.0B | 6.07 GiB | 0.38 GiB | 7.40 GiB | 0.04 GiB | 25±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 4.76 it/s | 3.92–5.05 | 126 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6600 XT run?
- 1413 of 2118 indexed open-weight models fit a Radeon RX 6600 XT at 4,096 context with q8_0 KV cache, the largest being Ling-lite at Q2_K. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6600 XT actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6600 XT fast for local AI?
- Its memory bandwidth is 256 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.