Radeon RX 6650 XT
Radeon RX 6650 XT has 8 GB of VRAM at 280 GB/s — about 7.44 GiB usable after driver and compositor overhead. 431 of 2118 indexed models fit at 128K context with f16 KV.
What fits at 128K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Agents-A1-4B-Heretic-ARA-Refusals8 | Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-NSFW-ARA-Heretic-Literotica | I1-Q4_K_M | 4.2B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Agents-A1-4B | Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-RpRMax-v1 | I1-Q4_K_M | 4.7B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Holo-3.1-4B-uncensored-heretic | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| GRaPE-2-Mini | I1-Q4_K_M | 4.7B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-DPO-4B-2 | I1-Q4_K_M | 4.2B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-Base | Q4_K_M | 4.7B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-heretic | Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| NuExtract3 | Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated | I1-Q4_K_M | 4.7B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwopus3.5-4B-v3-heretic | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B | Q4_K_M | 4.7B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Aureth-4B-Qwen3.5 | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-Claude-4.6-OS-Auto-Variable-HERETIC-UNCENSORED-THINKING | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-SOMPOA-heresy-v2 | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-SOMPOA-heresy | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen3.5-4B-Safety-Thinking | I1-Q4_K_M | 4.2B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Huihui-Qwen3.5-4B-abliterated | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Darkidol-Ballad-4B | I1-Q4_K_M | 4.5B | 2.52 GiB | 4.00 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma-3-4B-VL-it-Gemini-Pro-Heretic-Uncensored-Thinking | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-3-4b-it-roleplay-tuned-v1 | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| medgemma-1.5-4b-it | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-3-4b-it-roleplay-tuned-v2 | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| medgemma-4b-it | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-3-4b-it-heretic-uncensored-abliterated-Extreme | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-3-4b-it-abliterated | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| amoral-gemma3-4B-v1 | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma3-4B-CodeCenturion | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-3-4b-it | Q8_0 | 4.3B | 3.85 GiB | 2.67 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Dolphin3.0-Qwen2.5-3b | Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-3B-Instruct-abliterated | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| GRM-Kerlin-3b-Abliterated | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-3B-Instruct | Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Mythos-nano | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| MATE-3B | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Mythos-nano-OBLITERATED | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-3B-Instruct-Uncensored | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Nanonets-OCR-s | Q5_K_S | 3.8B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-3B-Instruct | Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-Coder-3B | Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| raspberry-3B | Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| VibeThinker-3B-OBLITERATED | I1-Q5_K_S | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| VibeThinker-3B | Q5_0 | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Fourier-Qwen2.5-VL-3B-0.67 | I1-Q5_K_S | 3.8B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Qwen2.5-VL-3B-Instruct | Q5_K_S | 3.8B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| jina-embeddings-v4 | Q5_K_S | 3.8B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| granite-3.1-1b-a400m-instructMoE | IQ3_M | 1.3B | 0.57 GiB | 6.00 GiB | 7.43 GiB | 0.01 GiB | 16±37% |
| Qwen2.5-3B-Instruct-abliterated | I1-IQ2_XS | 3.1B | 2.02 GiB | 4.50 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-heretic | Q4_1 | 8.0B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-uncensored | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-qat-q4_0-unquantized-heretic | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-qat-heretic_decensored | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-QAT-SOMPOA-heresy | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma4-e4b-mahou-nsfw | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-mentalchat16k | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma4-E4B-it-abliterated | I1-IQ4_XS | 7.9B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| gemma-4-E4B-it-OBLITERATED | I1-IQ4_XS | 8.0B | 4.69 GiB | 1.82 GiB | 7.43 GiB | 0.01 GiB | 27±26.5% |
| Gemma-4-E4B-Luchador | Q3_K_L | 8.0B | 4.69 GiB | 1.82 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
| Holo-3.1-4B | I1-Q3_K_L | 5.2B | 2.51 GiB | 4.00 GiB | 7.42 GiB | 0.02 GiB | 27±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 3.97 it/s | 2.63–4.85 | 138 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6650 XT run?
- 431 of 2118 indexed open-weight models fit a Radeon RX 6650 XT at 131,072 context with f16 KV cache, the largest being Agents-A1-4B-Heretic-ARA-Refusals8 at Q4_K_M. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6650 XT actually have?
- Its nameplate is 8 GB, but about 7.44 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6650 XT fast for local AI?
- Its memory bandwidth is 280 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.