Radeon RX 6650 XT
Radeon RX 6650 XT has 8 GB of VRAM at 280 GB/s — about 7.44 GiB usable after driver and compositor overhead. 1351 of 2118 indexed models fit at 8K context with f16 KV.
What fits at 8K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Marco-Nano-InstructMoE | I1-Q5_K_M | 8.0B | 5.69 GiB | 0.88 GiB | 7.44 GiB | 0.00 GiB | 67±37% |
| internlm3-8b-instruct | Q5_K_L | 8.8B | 6.14 GiB | 0.38 GiB | 7.44 GiB | 0.00 GiB | 27±26.5% |
| EVA-abliterated-TIES-Qwen2.5-14B | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Neuron-V1-14B-Instruct | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Ektome-Qwen2.5-Coder-14B-Instruct-PristinelyUncensored | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-14B-Instruct-1M-abliterated | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepCoder-14B-Preview | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Deepseeker-Kunou-Qwen2.5-14b | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| SuperNova-Medius | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| 14B-Qwen2.5-Kunou-v1 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Sugoi-14B-Ultra-HF | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-14B-Instruct-abliterated | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| OpenCodeReasoning-Nemotron-14B | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-14B-Instruct | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepSeek-R1-Distill-Qwen-14B-abliterated-v2 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| C1-Tachu | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepSeek-R1-Distill-Qwen-14B-abliterated | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| 0x-lite | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-14B-Instruct | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Tessera-4 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-14B-Instruct | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Tessera-4.1 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-14B-Instruct-1M | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-14B | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| AceReason-Nemotron-14B | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepSeek-R1-Distill-Qwen-14B | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| UwU-14B-Math-v0.2 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| EVA-Qwen2.5-14B-v0.2 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| EVA-Qwen2.5-14B-v0.0 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| EVA-Qwen2.5-14B-v0.1 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| oxy-1-small | IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Impish_QWEN_14B-1M | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| zeta-2.1 | I1-Q5_K_M | 8.3B | 5.49 GiB | 1.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Lamarck-14B-v0.7 | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| QwenStock-14B | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepSeek-R1-Distill-Qwen-14B-Uncensored | I1-IQ2_M | 14.8B | 4.99 GiB | 1.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| DeepSeek-R1-Distill-Llama-8B-Abliterated | I1-IQ2_M | 8.0B | 5.49 GiB | 1.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Falcon3-10B-Instruct | IQ4_XS | 10.3B | 5.21 GiB | 1.25 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Smilodon-9B-v1 | I1-Q3_K_M | 10.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| bella-bartender-v2 | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma-The-Writer-9B-HERETIC-Uncensored-Abliterated | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma-2-9B-It-SPPO-Iter3 | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma-SEA-LION-v3-9B-IT | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| G2-Darkest-Writer-Dirty-Shirley-9B-v2 | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| G2-Darkest-Writer-9B-v1 | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Tiger-Gemma-9B-v3 | I1-Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-2-9b-it-abliterated | Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-2-9b-it | Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Tiger-Gemma-9B-v1 | Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| magnum-v4-9b | Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-2-9b | Q3_K_M | 9.2B | 4.43 GiB | 2.05 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Yi-1.5-6B-Chat | Q8_0 | 6.1B | 6.00 GiB | 0.50 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| NVIDIA-Nemotron-Nano-9B-v2 | IQ3_XXS | 8.9B | 4.73 GiB | 1.75 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| GLM-4.6V-Flash | Q4_K_L | 10.3B | 6.17 GiB | 0.31 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| GLM-Z1-9B-0414 | Q4_K_L | 9.4B | 6.17 GiB | 0.31 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| GLM-4-9B-0414 | Q4_K_L | 9.4B | 6.17 GiB | 0.31 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| Bonsai-8B-unpacked | Q5_K_S | 8.2B | 5.36 GiB | 1.13 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| ERNIE-21B-A3B-Thinking-Gemini-3-Pro-High-Reasoning-V2 | I1-IQ2_S | 21.8B | 6.06 GiB | 0.44 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| ERNIE-21B-A3B-Claude-4.5-High-OPUS-Thinking | I1-IQ2_S | 21.8B | 6.06 GiB | 0.44 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 3.97 it/s | 2.63–4.85 | 138 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6650 XT run?
- 1351 of 2118 indexed open-weight models fit a Radeon RX 6650 XT at 8,192 context with f16 KV cache, the largest being Marco-Nano-Instruct at I1-Q5_K_M. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6650 XT actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6650 XT fast for local AI?
- Its memory bandwidth is 280 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.