Radeon RX 6800 XT
Radeon RX 6800 XT has 16 GB of VRAM at 512 GB/s — about 14.88 GiB usable after driver and compositor overhead. 1856 of 2118 indexed models fit at 8K context with q8_0 KV.
What fits at 8K context
| Model | Best quant | Params | Weights● | KV● | Total in memory◐ | Headroom◐ | tok/s◐ |
|---|---|---|---|---|---|---|---|
| Qwen3-Coder-30B-A3B-InstructMoE | Q3_K_L | 30.5B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| Qwen3-VL-30B-A3B-ThinkingMoE | Q3_K_L | 31.1B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| MiroThinker-v1.0-30BMoE | Q3_K_L | 30.5B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| Qwen3-30B-A3BMoE | Q3_K_L | 30.5B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| Pantheon-Proto-RP-1.8-30B-A3BMoE | Q3_K_L | 30.5B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| Tongyi-DeepResearch-30B-A3BMoE | Q3_K_L | 30.5B | 13.58 GiB | 0.40 GiB | 14.87 GiB | 0.01 GiB | 83±37% |
| internlm2-math-plus-20b | I1-Q5_K_M | 19.9B | 13.11 GiB | 0.80 GiB | 14.87 GiB | 0.01 GiB | 23±26.5% |
| Muse-Glimmer-30B | Q3_K_L | 29.8B | 13.77 GiB | 0.10 GiB | 14.85 GiB | 0.03 GiB | 23±26.5% |
| command-r-35b-writer-v2 | I1-IQ1_M | 35.0B | 8.52 GiB | 5.31 GiB | 14.84 GiB | 0.04 GiB | 23±26.5% |
| Darwin-35B-A3B-OpusMoE | IQ3_XXS | 36.0B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| Aurora-Code-1MoE | IQ3_XXS | 34.7B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| granite-20b-code-instruct-8k | Q5_K_L | 20.1B | 13.86 GiB | 0.00 GiB | 14.84 GiB | 0.04 GiB | 23±26.5% |
| grug-35b-v2MoE | IQ3_XXS | 35.1B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| grug-35bMoE | IQ3_XXS | 35.1B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| WorldSim-Opus-3.6-35B-A3BMoE | IQ3_XXS | 35.1B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| Qwen3.6-35B-A3B-AnkoMoE | IQ3_XXS | 35.1B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| KAT-Coder-V2.5-DevMoE | IQ3_XXS | 34.7B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| Ornith-1.0-35BMoE | IQ3_XXS | 34.7B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| Nex-N2-miniMoE | IQ3_XXS | 35.1B | 13.85 GiB | 0.08 GiB | 14.84 GiB | 0.04 GiB | 118±37% |
| ThinkingCap-Qwen3.6-27B | Q3_K_M | 27.4B | 13.60 GiB | 0.27 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Tess-4-27B | Q3_K_M | 27.8B | 13.60 GiB | 0.27 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| gpt-oss-20b-hereticMoE | Q4_K_S | 20.9B | 13.83 GiB | 0.11 GiB | 14.83 GiB | 0.05 GiB | 67±37% |
| IQuest-Coder-V1-40B-Instruct | I1-IQ2_M | 39.8B | 12.50 GiB | 1.33 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Caller | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Dumpling-Qwen2.5-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OREAL-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| QwQ-32B-Preview-abliterated-linear25 | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| openhands-lm-32b-v0.1 | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B-abliterated | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| m1-32b | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| XMainframe-v2-Instruct-32b | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B-Python-Specialist | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-32b-RP-Ink | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| LongWriter-Zero-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OpenCodeReasoning-Nemotron-32B-IOI | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B-Instruct-abliterated | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OlympicCoder-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OpenCodeReasoning-Nemotron-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OpenThinker-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| QwQ-32B-ArliAI-RpR-v4 | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B-Instruct | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| QwQ-32B-abliterated | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| DeepSeek-R1-Distill-Qwen-32B-heretic | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| InnoSpark-HPC-RM-32B | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| OpenThinker2-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| INTELLECT-2 | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-32B-Instruct | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-Coder-32B-Instruct-Uncensored | I1-IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| QwQ-32B-Preview | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| TinyR1-32B-Preview | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| deepseek-r1-qwen-2.5-32B-ablated | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Rombos-LLM-V2.5-Qwen-32b | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| DeepSeek-R1-Distill-Qwen-32B-abliterated | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-32B-ArliAI-RPMax-v1.3 | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| DeepSeek-R1-Distill-Qwen-32B | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| Qwen2.5-VL-32B-Instruct | IQ3_XS | 33.5B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| EVA-Qwen2.5-32B-v0.2 | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| EVA-Qwen2.5-32B-v0.1 | IQ3_XS | 32.8B | 12.76 GiB | 1.06 GiB | 14.83 GiB | 0.05 GiB | 23±26.5% |
| MN-GRAND-23.5B-Gutenberg-UNCENSORED-V2-GLM4.7-Thinking | I1-Q4_K_S | 23.4B | 12.53 GiB | 1.34 GiB | 14.82 GiB | 0.06 GiB | 23±26.5% |
Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.
Measured on this card
| Workload◍ | Median | Middle 50% | Runs |
|---|---|---|---|
| Image generation | 8.45 it/s | 5.93–10.04 | 215 |
Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.
Questions people ask
- What AI models can a Radeon RX 6800 XT run?
- 1856 of 2118 indexed open-weight models fit a Radeon RX 6800 XT at 8,192 context with q8_0 KV cache, the largest being Qwen3-Coder-30B-A3B-Instruct at Q3_K_L. That covers text, vision-language, image, video and speech models.
- How much usable memory does a Radeon RX 6800 XT actually have?
- Its nameplate is 16 GB, but about 14.88 GiB is available to a model once driver and compositor overhead is accounted for.
- Is a Radeon RX 6800 XT fast for local AI?
- Its memory bandwidth is 512 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.