Radeon RX 6600
Radeon RX 6600 has 8 GB of VRAM at 224 GB/s — about 7.44 GiB usable after driver and compositor overhead. 1207 of 2118 indexed models fit at 16K context with f16 KV.
What fits at 16K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Ministral-3-8B-Instruct-2512-BF16-abliterated | I1-IQ4_XS | 8.9B | 4.37 GiB | 2.13 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Ministral-3-8B-Instruct-2512-BF16 | IQ4_XS | 8.9B | 4.37 GiB | 2.13 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Amaretto-8B | I1-IQ4_XS | 8.9B | 4.37 GiB | 2.13 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| zeta-2.1 | I1-IQ4_NL | 8.3B | 4.50 GiB | 2.00 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Nexa-AI-4x4B-InstructMoE | I1-Q2_K | 12.1B | 4.28 GiB | 2.25 GiB | 7.44 GiB | 0.00 GiB | 18±37% |
| llm-jp-4-8b-instruct | IQ4_XS | 8.6B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| next-8b | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Supertron2-Reranker-8B | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| next-ocr | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-8B-GLM-4.7-Flash-Heretic-Uncensored-Thinking | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Midas-FableAgent-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-8B-Heretic-1.3.0 | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-8B-Thinking-Unredacted-MAX | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-8B-Instruct-Minecraft-MT-en-zh | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen-3-VL-8B-Instruct-heretic | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Poe-8B-GLM5-Opus4.6-Sonnet4.5-Kimi-Grok-Gemini-3-pro-preview-HERETIC | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| ToolCUA-8B | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Huihui-Qwen3-VL-8B-Instruct-abliterated | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-Reranker-8B | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Salience-1-9B | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-VL-8B-Instruct-Uncensored-V2 | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Maestro1-9B | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| GRaPE-2-Flash | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Jan-v2-VL-med | I1-IQ4_XS | 8.8B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Parable-Qwen3-8B-Claude-Fable-5 | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| ReasonCritic-7B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| mythos-9b-unhinged-heretic | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Finch-8B-KTO | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Finch-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| MathSmith-hc-Qwen3-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| MiroThinker-v1.0-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| mythos-9b-unhinged | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Ektome-Qwen3-8B-PristinelyUncensored | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Marco-DeepResearch-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| mythos-9b-merged | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| qwen3-8b-apostate | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Josiefied-Qwen3-8B-abliterated-v1 | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| tmax-8b | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-8B-DeepSeek-v3.2-Speciale-Distill | IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-8B-abliterated | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| story_generation_Qwen3_8B_RL | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| AReaL-boba-2-8B-Open | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Nemotron-Orchestrator-8B | IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| S1-Base-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Huihui-Qwen3-8B-abliterated-v2 | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Step3-VL-10B-Base | I1-IQ4_XS | 10.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| phi-2 | Q4_K_S | 2.8B | 1.52 GiB | 5.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3-Reranker-8B | I1-IQ4_XS | 8.2B | 4.25 GiB | 2.25 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Aya-Medikal-V2 | I1-IQ4_NL | 8.0B | 4.48 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Kimi-VL-A3B-InstructMoE | I1-IQ2_M | 16.4B | 6.03 GiB | 0.47 GiB | 7.42 GiB | 0.02 GiB | 56±37% |
| Moonlight-16B-A3B-InstructMoE | IQ2_M | 16.0B | 6.03 GiB | 0.47 GiB | 7.42 GiB | 0.02 GiB | 56±37% |
| Phi-4-reasoning | UD-IQ1_S | 14.7B | 3.33 GiB | 3.13 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Phi-4-reasoning-plus | UD-IQ1_S | 14.7B | 3.33 GiB | 3.13 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Apriel-1.6-15b-Thinker | I1-IQ1_M | 14.9B | 3.47 GiB | 3.00 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Wan2.1-T2V-1.3B | Q4_0 | 1.4B | 6.50 GiB | 0.00 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| AMALIA-9B-0626-DPO | Q3_K_S | 9.2B | 3.86 GiB | 2.63 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Gemma-4-E4B-Luchador | Q5_K_L | 8.0B | 6.21 GiB | 0.29 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Hy-MT2-7B | Q4_1 | 8.0B | 4.47 GiB | 2.00 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Homunculus | IQ2_S | 12.5B | 3.96 GiB | 2.50 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 2.06 it/s | 0.90–3.30 | 91 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6600 run?
- 1207 of 2118 indexed open-weight models fit a Radeon RX 6600 at 16,384 context with f16 KV cache, the largest being Ministral-3-8B-Instruct-2512-BF16-abliterated at I1-IQ4_XS. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6600 actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6600 fast for local AI?
- Its memory bandwidth is 224 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.