Radeon RX 6600
Radeon RX 6600 has 8 GB of VRAM at 224 GB/s — about 7.44 GiB usable after driver and compositor overhead. 615 of 2118 indexed models fit at 64K context with f16 KV.
What fits at 64K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Qwen3.5-9B | Q3_K_M | 9.7B | 4.50 GiB | 2.00 GiB | 7.44 GiB | 0.00 GiB | 22±26.5% |
| Crow-9B-HERETIC-4.6 | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Claude-4.6-OS-Auto-Variable-HERETIC-UNCENSORED-THINKING | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Claude-4.6-OS-HERETIC-UNCENSORED-INSTRUCT | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-HERETIC-UNCENSORED | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| NaNovel-9B | I1-Q3_K_L | 9.7B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Unredacted-MAX | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-abliterated | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Ken3.5-9B | I1-Q3_K_L | 9.7B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Huihui-Qwen3.5-9B-abliterated | Q3_K_L | 9.7B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-abliterated | Q3_K_L | 9.0B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-Base | Q3_K_L | 9.7B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| Qwen3.5-9B-gemini-3.1-opus-4.6-reasoning | I1-Q3_K_L | 9.4B | 4.49 GiB | 2.00 GiB | 7.43 GiB | 0.01 GiB | 22±26.5% |
| SmolLM3-3B | Q5_K_S | 3.1B | 2.01 GiB | 4.50 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Wan2.1-T2V-1.3B | Q4_0 | 1.4B | 6.50 GiB | 0.00 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Huihui-gemma-3n-E4B-it-abliterated | Q5_K_L | 7.8B | 5.55 GiB | 0.93 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| gemma-3n-E4B-it | Q5_K_L | 7.8B | 5.55 GiB | 0.93 GiB | 7.42 GiB | 0.02 GiB | 22±26.5% |
| Parable-Granite-4.1-3B-Claude-Fable-5 | I1-IQ3_M | 3.4B | 1.51 GiB | 5.00 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| granite-4.0-micro | IQ3_M | 3.4B | 1.51 GiB | 5.00 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| EXAONE-4.0-1.2B-abliterated | F16 | 1.5B | 2.78 GiB | 3.75 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Qwythos-9B-v2 | Q3_K_S | 9.7B | 4.48 GiB | 2.00 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| Tess-4-9B | Q3_K_S | 9.7B | 4.48 GiB | 2.00 GiB | 7.41 GiB | 0.03 GiB | 22±26.5% |
| granite-3.1-3b-a800m-instructMoE | Q6_K_L | 3.3B | 2.54 GiB | 4.00 GiB | 7.41 GiB | 0.03 GiB | 18±37% |
| Qwen2.5-VL-7B-Instruct | UD-IQ3_XXS | 8.3B | 2.95 GiB | 3.50 GiB | 7.40 GiB | 0.04 GiB | 22±26.5% |
| snowflake-arctic-embed-l-v2.0 | Q6_K_L | 568M | 0.52 GiB | 6.00 GiB | 7.40 GiB | 0.04 GiB | 22±26.5% |
| Qwen2.5-3B-Instruct-abliterated | I1-Q5_K_S | 3.1B | 4.24 GiB | 2.25 GiB | 7.40 GiB | 0.04 GiB | 22±26.5% |
| Qwen3.6-35B-A3B-REAM-160-ru-agentMoE | IQ1_S | 23.6B | 5.24 GiB | 1.25 GiB | 7.40 GiB | 0.04 GiB | 43±37% |
| granite-3.3-2b-instruct | Q4_1 | 2.5B | 1.50 GiB | 5.00 GiB | 7.39 GiB | 0.05 GiB | 22±26.5% |
| granite-3.2-2b-instruct | Q4_1 | 2.5B | 1.50 GiB | 5.00 GiB | 7.39 GiB | 0.05 GiB | 22±26.5% |
| granite-vision-3.2-2b | Q4_1 | 3.0B | 1.50 GiB | 5.00 GiB | 7.39 GiB | 0.05 GiB | 22±26.5% |
| GLM-4.6V-Flash | UD-IQ3_XXS | 10.3B | 3.94 GiB | 2.50 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| GLM-Z1-9B-0414 | UD-IQ3_XXS | 9.4B | 3.94 GiB | 2.50 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| GLM-4-9B-0414 | UD-IQ3_XXS | 9.4B | 3.94 GiB | 2.50 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| GLM-4.1V-9B-Thinking | UD-IQ3_XXS | 10.3B | 3.94 GiB | 2.50 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| granite-speech-4.1-2b | Q4_K_M | 2.3B | 1.49 GiB | 5.00 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| granite-4.0-1b-speech | Q4_K_M | 2.3B | 1.49 GiB | 5.00 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| granite-3.1-2b-instruct | Q4_1 | 2.5B | 1.48 GiB | 5.00 GiB | 7.38 GiB | 0.06 GiB | 22±26.5% |
| glm4.1v-9b-base-sft | I1-IQ3_XXS | 10.3B | 3.94 GiB | 2.50 GiB | 7.37 GiB | 0.07 GiB | 22±26.5% |
| GrammarCoder-7B-Base | I1-IQ3_XXS | 7.6B | 2.91 GiB | 3.50 GiB | 7.36 GiB | 0.08 GiB | 22±26.5% |
| granite-4.1-3b | Q3_K_S | 3.4B | 1.46 GiB | 5.00 GiB | 7.36 GiB | 0.08 GiB | 22±26.5% |
| granite-4.0-micro-base | Q3_K_S | 3.4B | 1.46 GiB | 5.00 GiB | 7.36 GiB | 0.08 GiB | 22±26.5% |
| GLM-ASR-Nano-2512 | BF16 | 2.3B | 2.97 GiB | 3.50 GiB | 7.36 GiB | 0.08 GiB | 22±26.5% |
| InternVL3_5-14B | IQ3_M | 15.1B | 6.41 GiB | 0.00 GiB | 7.36 GiB | 0.08 GiB | 22±26.5% |
| DeepHat-V1-7B-Heretic-Abliterated | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| ShizhenGPT-7B-VL | I1-IQ3_XXS | 8.3B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| HuatuoGPT-o1-7B | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| MathSmith-DS-Qwen-7B-LongCoT | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| AstraGPTCoder-7B | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Qwen2.5-Coder-7B-Instruct-Ghidra-v2 | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| EsDrac-v1-7B | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Hemlock-Apothecary-7B-GRPO-e3 | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| openhands-lm-7b-v0.1 | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Hemlock2-Coder-7B-GRPO | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| shellwhiz-7b | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Qwen2.5-Coder-7B-Instruct-abliterated | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Qwen2.5-Coder-7B-Instruct-OBLITERATED-advanced | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| Qwen-STEM-Specialist-7B | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| DeepHat-V1-7B | IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
| VulnLLM-R-7B | I1-IQ3_XXS | 7.6B | 2.90 GiB | 3.50 GiB | 7.35 GiB | 0.09 GiB | 22±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 2.06 it/s | 0.90–3.30 | 91 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6600 run?
- 615 of 2118 indexed open-weight models fit a Radeon RX 6600 at 65,536 context with f16 KV cache, the largest being Qwen3.5-9B at Q3_K_M. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6600 actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6600 fast for local AI?
- Its memory bandwidth is 224 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.