Radeon RX 6600
Radeon RX 6600 has 8 GB of VRAM at 224 GB/s — about 7.44 GiB usable after driver and compositor overhead. 1416 of 2118 indexed models fit at 8K context with q4_0 KV.
What fits at 8K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| gemma-4-19B-A4B-it-INSTRUCT-Heretic-UncensoredMoE | I1-IQ2_XXS | 19.0B | 6.38 GiB | 0.17 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| gemma-4-19B-A4B-it-The-DECKARD-Heretic-Uncensored-ThinkingMoE | I1-IQ2_XXS | 19.0B | 6.38 GiB | 0.17 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| gemma-4-19b-a4b-it-REAP-hereticMoE | I1-IQ2_XXS | 19.0B | 6.38 GiB | 0.17 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Gemma-4-19BMoE | I1-IQ2_XXS | 19.0B | 6.38 GiB | 0.17 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| GPT-NeoX-20B-Erebus | I1-IQ1_S | 20.6B | 4.12 GiB | 2.32 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| codegeex4-all-9b | IQ4_NL | 9.4B | 5.08 GiB | 1.41 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Apriel-1.6-15b-Thinker | I1-IQ3_S | 14.9B | 6.06 GiB | 0.42 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Phi-3-medium-128k-instruct | IQ3_M | 14.0B | 6.03 GiB | 0.44 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Phi-3-medium-4k-instruct | I1-IQ3_M | 14.0B | 6.03 GiB | 0.44 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| granite-vision-4.1-4b | BF16 | 4.0B | 6.34 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Parable-Granite-4.1-3B-Claude-Fable-5 | F16 | 3.4B | 6.34 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| granite-4.0-micro | BF16 | 3.4B | 6.34 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| granite-4.1-3b | BF16 | 3.4B | 6.34 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| granite-4.0-micro-base | BF16 | 3.4B | 6.34 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| dolphincoder-starcoder2-15bKV unresolved | I1-IQ3_XS | 16.0B | 6.25 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| starcoder2-15bKV unresolved | IQ3_XS | 16.0B | 6.25 GiB | 0.18 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Qwen2.5-3B-Instruct-abliterated | Q8_0 | 3.1B | 6.43 GiB | 0.08 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| GLM-4.7-Flash-DerestrictedMoE | I1-IQ1_M | 31.2B | 6.39 GiB | 0.12 GiB | 7.42 GiB | 0.02 GiB | 83±37% |
| Huihui-GLM-4.7-Flash-abliteratedMoE | I1-IQ1_M | 31.2B | 6.39 GiB | 0.12 GiB | 7.42 GiB | 0.02 GiB | 83±37% |
| Wan2.1-T2V-1.3B | Q4_0 | 1.4B | 6.50 GiB | 0.00 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| reka-flash-3.1 | I1-IQ1_S | 20.9B | 6.15 GiB | 0.29 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| granite-8b-code-instruct-4k | I1-Q6_K | 8.1B | 6.16 GiB | 0.32 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| granite-8b-code-base-4k | I1-Q6_K | 8.1B | 6.16 GiB | 0.32 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Grug-12B | Q3_K_L | 12.0B | 6.20 GiB | 0.27 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| gemma-4-12B-it-Esper4 | Q3_K_L | 12.0B | 6.20 GiB | 0.27 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| gemma-4-12B-it | Q3_K_L | 12.0B | 6.20 GiB | 0.27 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| internlm2-math-plus-20b | I1-IQ2_S | 19.9B | 6.03 GiB | 0.42 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Forsaken-Void-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Silver-Siren-ST-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Tess-3-Mistral-Nemo-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| MN-12B-Runeweaver-RP-RU | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Dans-PersonalityEngine-V1.3.0-12b | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Impish_Bloodmoon_12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Wayfarer-2-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Wayfarer-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Muse-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Vikhr-Nemo-12B-Instruct-R-21-09-24 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-Base-2407 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| writing-roleplay-20k-context-nemo-12b-v1.0 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| mini-magnum-12b-v1.1 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Lumimaid-v0.2-12B | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| MN-Violet-Lotus-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Rocinante-X-12B-v1-Heretic-Uncensored | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Heretica-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Violet_Twilight-v0.2 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Lumimaid-Magnum-v4-12B | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| arcee-fusion-lumaid-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-NeMo-12B-Abliterated | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Captain-Eris_Violet-V0.420-12B | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Rocinante-X-12B-v1-absolute-heresy | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Rocinante-X-12B-v1 | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-Gutenberg-Doppel-12B | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-Instruct-2407 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| magnum-v4-12b | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| MN-12b-RP-Ink | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-12B-ArliAI-RPMax-v1.1 | Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Dans-SakuraKaze-V1.0.0-12b | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Mistral-Nemo-Instruct-2407-12B-Thinking-M-Claude-Opus-High-Reasoning | I1-Q3_K_L | 12.2B | 6.11 GiB | 0.35 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 2.06 it/s | 0.90–3.30 | 91 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6600 run?
- 1416 of 2118 indexed open-weight models fit a Radeon RX 6600 at 8,192 context with q4_0 KV cache, the largest being gemma-4-19B-A4B-it-INSTRUCT-Heretic-Uncensored at I1-IQ2_XXS. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6600 actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6600 fast for local AI?
- Its memory bandwidth is 224 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.