Radeon RX 6750 GRE
Radeon RX 6750 GRE has 12 GB of VRAM at 384 GB/s — about 11.16 GiB usable after driver and compositor overhead. 1711 of 2118 indexed models fit at 16K context with q8_0 KV.
What fits at 16K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Huihui-Qwen3-Coder-30B-A3B-Instruct-abliteratedMoE | I1-IQ2_M | 30.5B | 9.47 GiB | 0.80 GiB | 11.16 GiB | 0.00 GiB | 67±37% |
| Qwen3-Coder-30B-A3B-Instruct-RTPurboMoE | I1-IQ2_M | 30.5B | 9.47 GiB | 0.80 GiB | 11.16 GiB | 0.00 GiB | 67±37% |
| Nous-Capybara-limarpv3-34B | I1-IQ1_M | 34.4B | 8.18 GiB | 1.99 GiB | 11.15 GiB | 0.01 GiB | 24±26.5% |
| Muse-Glimmer-30B | UD-IQ2_XXS | 29.8B | 10.01 GiB | 0.16 GiB | 11.15 GiB | 0.01 GiB | 24±26.5% |
| glm-4-9b-chat-abliterated | IQ4_XS | 9.4B | 4.89 GiB | 5.31 GiB | 11.15 GiB | 0.01 GiB | 24±26.5% |
| GLM-4.7-Flash-hereticMoE | IQ2_M | 29.9B | 9.80 GiB | 0.44 GiB | 11.15 GiB | 0.01 GiB | 79±37% |
| dolphin-2.6-mixtral-8x7bMoE | I1-IQ1_S | 46.7B | 9.15 GiB | 1.06 GiB | 11.15 GiB | 0.01 GiB | 36±37% |
| xLAM-8x7b-rMoE | IQ1_S | 46.7B | 9.15 GiB | 1.06 GiB | 11.15 GiB | 0.01 GiB | 36±37% |
| Qwen3.5-40B-RoughHouse-Claude-4.6-Opus-Polar-Deckard-Uncensored-Heretic-Thinking | I1-IQ1_S | 39.5B | 9.38 GiB | 0.80 GiB | 11.14 GiB | 0.02 GiB | 24±26.5% |
| GLM-4.7-FlashMoE | UD-IQ2_XXS | 31.2B | 9.79 GiB | 0.44 GiB | 11.14 GiB | 0.02 GiB | 79±37% |
| ERNIE-21B-A3B-Thinking-Gemini-3-Pro-High-Reasoning-V2 | I1-Q3_K_M | 21.8B | 9.75 GiB | 0.46 GiB | 11.13 GiB | 0.03 GiB | 24±26.5% |
| ERNIE-21B-A3B-Claude-4.5-High-OPUS-Thinking | I1-Q3_K_M | 21.8B | 9.75 GiB | 0.46 GiB | 11.13 GiB | 0.03 GiB | 24±26.5% |
| ERNIE-4.5-21B-A3B-Thinking | I1-Q3_K_M | 21.8B | 9.75 GiB | 0.46 GiB | 11.13 GiB | 0.03 GiB | 24±26.5% |
| Bielik-11B-v2.3-Instruct | Q6_K | 11.2B | 8.53 GiB | 1.66 GiB | 11.13 GiB | 0.03 GiB | 24±26.5% |
| Darwin-35B-A3B-OpusMoE | IQ2_XS | 36.0B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| Aurora-Code-1MoE | IQ2_XS | 34.7B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| grug-35b-v2MoE | IQ2_XS | 35.1B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| grug-35bMoE | IQ2_XS | 35.1B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| WorldSim-Opus-3.6-35B-A3BMoE | IQ2_XS | 35.1B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| Qwen3.6-35B-A3B-AnkoMoE | IQ2_XS | 35.1B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| KAT-Coder-V2.5-DevMoE | IQ2_XS | 34.7B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| Ornith-1.0-35BMoE | IQ2_XS | 34.7B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| Nex-N2-miniMoE | IQ2_XS | 35.1B | 10.06 GiB | 0.17 GiB | 11.13 GiB | 0.03 GiB | 112±37% |
| Qwen3-16B-A3BMoE | Q4_1 | 16.0B | 9.43 GiB | 0.80 GiB | 11.12 GiB | 0.04 GiB | 53±37% |
| Devstral-Small-2-24B-Instruct-2512 | UD-IQ3_XXS | 24.0B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Mistral-Small-3.2-24B-Instruct-2506 | UD-IQ3_XXS | 24.0B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Devstral-Small-2507 | UD-IQ3_XXS | 23.6B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Devstral-Small-2505 | UD-IQ3_XXS | 23.6B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Magistral-Small-2509 | UD-IQ3_XXS | 24.0B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Magistral-Small-2507 | UD-IQ3_XXS | 23.6B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Mistral-Small-3.1-24B-Instruct-2503 | UD-IQ3_XXS | 24.0B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Magistral-Small-2506 | UD-IQ3_XXS | 23.6B | 8.76 GiB | 1.33 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| Qwen3.8-27B | UD-IQ2_M | 27.8B | 9.61 GiB | 0.53 GiB | 11.11 GiB | 0.05 GiB | 24±26.5% |
| InternVL3_5-30B-A3B | Q2_K | 30.8B | 10.16 GiB | 0.00 GiB | 11.10 GiB | 0.06 GiB | 24±26.5% |
| Rocinante-XL-16B-v1 | IQ4_XS | 16.1B | 8.36 GiB | 1.79 GiB | 11.10 GiB | 0.06 GiB | 24±26.5% |
| EuroLLM-22B-Instruct-2512 | IQ3_XXS | 22.6B | 8.34 GiB | 1.79 GiB | 11.10 GiB | 0.06 GiB | 24±26.5% |
| Snowpiercer-15B-v4-heretic | I1-Q4_K_M | 15.0B | 8.49 GiB | 1.66 GiB | 11.09 GiB | 0.07 GiB | 24±26.5% |
| Snowpiercer-15B-v4 | Q4_K_M | 15.0B | 8.49 GiB | 1.66 GiB | 11.09 GiB | 0.07 GiB | 24±26.5% |
| North-Mini-Code-1.0MoE | IQ2_M | 30.5B | 9.82 GiB | 0.38 GiB | 11.09 GiB | 0.07 GiB | 81±37% |
| Phi-3-mini-4k-instructKV unresolved | IQ4_XS | 3.8B | 6.99 GiB | 3.19 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| GRM-2.6-Plus-0628 | IQ2_S | 27.8B | 9.59 GiB | 0.53 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| ThinkingCap-Qwen3.6-27B | IQ2_S | 27.4B | 9.59 GiB | 0.53 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| Tess-4-27B | IQ2_S | 27.8B | 9.59 GiB | 0.53 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| Nemotron-Mini-4B-Instruct | Q5_K_S | 4.2B | 9.10 GiB | 1.06 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| Qwen3-42B-A3B-2507-Thinking-Abliterated-uncensored-TOTAL-RECALL-v2-Medium-MASTER-CODERMoE | I1-IQ1_M | 42.4B | 9.08 GiB | 1.11 GiB | 11.08 GiB | 0.08 GiB | 59±37% |
| MythoMax-L2-13b | I1-IQ2_XXS | 13.0B | 3.50 GiB | 6.64 GiB | 11.08 GiB | 0.08 GiB | 24±26.5% |
| Llama3.2-24B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-UncensoredMoE | IQ4_XS | 18.0B | 9.24 GiB | 0.93 GiB | 11.08 GiB | 0.08 GiB | 51±37% |
| Qwen3-VL-8B-Instruct-Heretic | I1-Q4_K_S | 8.8B | 8.94 GiB | 1.20 GiB | 11.07 GiB | 0.09 GiB | 24±26.5% |
| Apriel-1.6-15b-Thinker | I1-Q4_1 | 14.9B | 8.53 GiB | 1.59 GiB | 11.07 GiB | 0.09 GiB | 24±26.5% |
| gemma-4-12B | Q6_K_M | 12.0B | 9.34 GiB | 0.78 GiB | 11.07 GiB | 0.09 GiB | 24±26.5% |
| Llama3.2-30B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-UncensoredMoE | I1-IQ2_S | 30.0B | 8.60 GiB | 1.56 GiB | 11.07 GiB | 0.09 GiB | 43±37% |
| Qwen3.6-35B-A3B-REAM-160-ru-agentMoE | IQ3_M | 23.6B | 9.99 GiB | 0.17 GiB | 11.06 GiB | 0.10 GiB | 98±37% |
| UncensoredLM-DeepSeek-R1-Distill-Qwen-14B | Q4_K_L | 14.2B | 8.58 GiB | 1.53 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| medgemma-27b-it | I1-Q2_K_S | 28.8B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| gemma-3-27b-it-abliterated-refined-vision | I1-Q2_K_S | 27.4B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| Nidum-Gemma-3-27B-it-Uncensored | I1-Q2_K_S | 27.4B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| AtomicGPT-gemma3-27b | I1-Q2_K_S | 27.4B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| Unbound-v1.12.0-27B | I1-Q2_K_S | 27.4B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| Mira-v1.12-Ties-27B | I1-Q2_K_S | 27.4B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
| Medgamma27B | I1-Q2_K_S | 27.0B | 9.09 GiB | 0.99 GiB | 11.06 GiB | 0.10 GiB | 24±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 3.37 it/s | 2.97–3.45 | 28 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6750 GRE run?
- 1711 of 2118 indexed open-weight models fit a Radeon RX 6750 GRE at 16,384 context with q8_0 KV cache, the largest being Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated at I1-IQ2_M. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6750 GRE actually have?
- Its nameplate is 12 GB, but about 11.16 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6750 GRE fast for local AI?
- Its memory bandwidth is 384 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.