AMD · consumer

Radeon RX 6800 XT

Radeon RX 6800 XT has 16 GB of VRAM at 512 GB/s — about 14.88 GiB usable after driver and compositor overhead. 1866 of 2118 indexed models fit at 4K context with q4_0 KV.

Spec sheet· bandwidth, theoreticalFrom the file· fit from summed bytesPredicted· speed
Memory
16 GB
GDDR6
Bandwidth
512 GB/s
256-bit bus
Tensor FP16
dense
TDP
300 W
$649 MSRP
KV cachef16q8_0q4_0quantizing the KV cache is a ~2× lever on the dominant term at long context
text 1600vision language 163video 15audio asr 39image 2embedding 26audio tts 21

What fits at 4K context

largest quantization that fits, per model · 1866 of 2118 indexed
ModelBest quantParamsWeightsKVTotal in memoryHeadroomtok/s
Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-UncensoredMoEI1-IQ3_M33.6B13.81 GiB0.16 GiB14.88 GiB0.00 GiB55±37%
GLM-Z1-Rumination-32B-0414Q3_K_S33.1B13.62 GiB0.27 GiB14.87 GiB0.01 GiB23±26.5%
gemma-4-E4B-uncensoredF167.9B13.92 GiB0.03 GiB14.87 GiB0.01 GiB23±26.5%
gemma-4-E4B-it-qat-heretic_decensoredF167.9B13.92 GiB0.03 GiB14.87 GiB0.01 GiB23±26.5%
gemma-4-E4B-it-QAT-SOMPOA-heresyF167.9B13.92 GiB0.03 GiB14.87 GiB0.01 GiB23±26.5%
gemma-4-E4B-it-hereticBF168.0B13.92 GiB0.03 GiB14.87 GiB0.01 GiB23±26.5%
Tinman-gemma4-companion-mergedBF167.9B13.92 GiB0.03 GiB14.87 GiB0.01 GiB23±26.5%
Gemma-4-31B-Isometry-RPI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Gemma-4-Dark-Gemistry-31BI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Prosopon-31BI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Gemma-4-Novelist-Eclipse-31BI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Giftige-Blume-31B-v1-StyleSwapI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
G4-MeroMero-31B-StyleSwapI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Gemma-4-31B-StyleTune-heretic-araI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Pantheon-Reasoning-31B-1.1I1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Gemma-4-31B-StyleTuneI1-IQ3_S32.7B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Barcenas-StyleTune-31B-FableI1-IQ3_S32.1B13.38 GiB0.51 GiB14.87 GiB0.01 GiB23±26.5%
Trinity-MiniMoEIQ4_NL26.1B13.92 GiB0.05 GiB14.87 GiB0.01 GiB96±37%
LFM2-24B-A2BMoEQ4_123.8B13.93 GiB0.02 GiB14.87 GiB0.01 GiB97±37%
Teuken-7B-instruct-research-v0.4F167.5B13.89 GiB0.04 GiB14.86 GiB0.02 GiB23±26.5%
WizardCoder-Python-34B-V1.0I1-IQ3_S33.7B13.65 GiB0.21 GiB14.86 GiB0.02 GiB23±26.5%
Phind-CodeLlama-34B-Python-v1I1-IQ3_S33.7B13.65 GiB0.21 GiB14.86 GiB0.02 GiB23±26.5%
Phind-CodeLlama-34B-v2I1-IQ3_S33.7B13.65 GiB0.21 GiB14.86 GiB0.02 GiB23±26.5%
GLM-4-32B-0414-Korean-CultureI1-IQ3_M32.6B13.80 GiB0.07 GiB14.86 GiB0.02 GiB23±26.5%
GLM-Z1-32B-0414IQ3_M32.6B13.80 GiB0.07 GiB14.86 GiB0.02 GiB23±26.5%
GLM-4-32B-0414IQ3_M32.6B13.80 GiB0.07 GiB14.86 GiB0.02 GiB23±26.5%
Laguna-XS-2.1MoEQ3_K_S33.4B13.87 GiB0.08 GiB14.85 GiB0.03 GiB119±37%
EXAONE-4.5-33BI1-IQ3_S34.4B13.57 GiB0.28 GiB14.85 GiB0.03 GiB23±26.5%
MythoMax-L2-Kimiko-v2-13bQ8_013.0B13.02 GiB0.88 GiB14.85 GiB0.03 GiB23±26.5%
Llama3.2-24B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-UncensoredMoEI1-Q6_K18.0B13.81 GiB0.12 GiB14.84 GiB0.04 GiB67±37%
granite-20b-code-instruct-8kQ5_K_L20.1B13.86 GiB0.00 GiB14.84 GiB0.04 GiB23±26.5%
Pantheon-Reasoning-27BQ3_K_M27.8B13.80 GiB0.07 GiB14.83 GiB0.05 GiB23±26.5%
Qwen3.5-27BQ3_K_M27.8B13.80 GiB0.07 GiB14.83 GiB0.05 GiB23±26.5%
Gemma4-Gutenberg-31BQ3_K_S31.3B13.34 GiB0.51 GiB14.83 GiB0.05 GiB23±26.5%
gemma-4-31B-itQ3_K_S31.3B13.34 GiB0.51 GiB14.83 GiB0.05 GiB23±26.5%
Gemma4-Gutenberg-31B-HereticQ3_K_S31.3B13.34 GiB0.51 GiB14.83 GiB0.05 GiB23±26.5%
Equinox-31BQ3_K_S31.3B13.34 GiB0.51 GiB14.83 GiB0.05 GiB23±26.5%
gemma-4-31B-it-SDFT-Heretic-RPQ3_K_S30.7B13.34 GiB0.51 GiB14.83 GiB0.05 GiB23±26.5%
Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-ThinkingIQ2_M39.5B13.76 GiB0.11 GiB14.83 GiB0.05 GiB23±26.5%
Llama-3.1-8BQ4_K_M8.0B13.75 GiB0.14 GiB14.83 GiB0.05 GiB23±26.5%
North-Mini-Code-1.0MoEIQ3_M30.5B13.84 GiB0.11 GiB14.83 GiB0.05 GiB93±37%
Qwen3.5-27B-HERETIC-Polaris-Advanced-Thinking-Alpha-uncensoredIQ4_XS27.4B13.78 GiB0.07 GiB14.82 GiB0.06 GiB23±26.5%
Qwen3.5-27B-Deckard-PKD-Heretic-Uncensored-ThinkingIQ4_XS27.4B13.78 GiB0.07 GiB14.82 GiB0.06 GiB23±26.5%
Qwen3.5-27B-hereticIQ4_XS27.4B13.78 GiB0.07 GiB14.82 GiB0.06 GiB23±26.5%
Huihui-Qwen3.5-27B-abliteratedIQ4_XS27.8B13.78 GiB0.07 GiB14.82 GiB0.06 GiB23±26.5%
Qwen3.5-27B-Claude-4.6-Opus-Reasoning-DistilledIQ4_XS27.8B13.78 GiB0.07 GiB14.82 GiB0.06 GiB23±26.5%
CodeLlama-34b-instruct-hfQ3_K_S33.7B13.60 GiB0.21 GiB14.81 GiB0.07 GiB23±26.5%
WizardLM-1.0-Uncensored-CodeLlama-34bQ3_K_S33.7B13.60 GiB0.21 GiB14.81 GiB0.07 GiB23±26.5%
Nous-Hermes-2-Yi-34BQ2_K34.4B13.56 GiB0.26 GiB14.80 GiB0.08 GiB23±26.5%
Capybara-Tess-Yi-34B-200KQ2_K34.4B13.56 GiB0.26 GiB14.80 GiB0.08 GiB23±26.5%
OrionStar-Yi-34B-Chat-LlamaQ2_K34.4B13.56 GiB0.26 GiB14.80 GiB0.08 GiB23±26.5%
Nous-Capybara-limarpv3-34BQ2_K34.4B13.56 GiB0.26 GiB14.80 GiB0.08 GiB23±26.5%
Delphi-25B-SimpleRL-MathIQ4_XS25.0B12.65 GiB1.18 GiB14.80 GiB0.08 GiB23±26.5%
Muse-Glimmer-30BQ3_K_L29.8B13.77 GiB0.04 GiB14.79 GiB0.09 GiB23±26.5%
medgemma-27b-itI1-Q3_K_L28.8B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
gemma-3-27b-it-abliterated-refined-visionI1-Q3_K_L27.4B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
gemma-3-27b-it-abliteratedQ3_K_L27.4B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
Nidum-Gemma-3-27B-it-UncensoredI1-Q3_K_L27.4B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
AtomicGPT-gemma3-27bI1-Q3_K_L27.4B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
Unbound-v1.12.0-27BI1-Q3_K_L27.4B13.54 GiB0.26 GiB14.78 GiB0.10 GiB23±26.5%
From the filePredictedwhat these mean

Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.

Measured on this card

third-party benchmarks, aggregated
WorkloadMedianMiddle 50%Runs
Image generation8.45 it/s5.9310.04215
Benchmarked· n=215

Aggregated from community-submitted runs, so the spread is wide by nature — it covers different models, resolutions, step counts and settings, not one controlled configuration. Read the middle 50% rather than the median alone. These figures are reproduced with attribution from vladmandic-sd-data-benchmark, which publishes no licence — so we display and link rather than redistribute them.

Questions people ask

What AI models can a Radeon RX 6800 XT run?
1866 of 2118 indexed open-weight models fit a Radeon RX 6800 XT at 4,096 context with q4_0 KV cache, the largest being Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-Uncensored at I1-IQ3_M. That covers text, vision-language, image, video and speech models.
How much usable memory does a Radeon RX 6800 XT actually have?
Its nameplate is 16 GB, but about 14.88 GiB is available to a model once driver and compositor overhead is accounted for.
Is a Radeon RX 6800 XT fast for local AI?
Its memory bandwidth is 512 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.