AMD · datacenter

Instinct MI210

Instinct MI210 has 64 GB of VRAM at 1638 GB/s — about 59.52 GiB usable after driver and compositor overhead. 2062 of 2118 indexed models fit at 16K context with q4_0 KV.

Spec sheet· bandwidth, theoreticalFrom the file· fit from summed bytesPredicted· speed
Memory
64 GB
HBM2e
Bandwidth
1638 GB/s
4096-bit bus
Tensor FP16
181 TF
dense
TDP
300 W
Context4K8K16K32K64K128K
KV cachef16q8_0q4_0quantizing the KV cache is a ~2× lever on the dominant term at long context
text 1773vision language 185image 2audio asr 39audio tts 21video 16embedding 26

What fits at 16K context

largest quantization that fits, per model · 2062 of 2118 indexed
ModelBest quantParamsWeights●KV●Total in memory◐Headroom◐tok/s◐
gpt-oss-120bMoEQ4_K_M120B58.46 GiB0.17 GiB59.51 GiB0.01 GiB97±37%
gpt-oss-safeguard-120bMoEQ4_K_M120B58.46 GiB0.17 GiB59.51 GiB0.01 GiB97±37%
gpt-oss-120b-uncensored-bf16MoEIQ4_NL117B58.40 GiB0.17 GiB59.46 GiB0.06 GiB97±37%
Qwen3.5-REAP-212B-A17BMoEIQ2_XS212B58.30 GiB0.13 GiB59.38 GiB0.14 GiB92±37%
grok-2MoEIQ1_M270B57.16 GiB1.13 GiB59.33 GiB0.19 GiB32±37%
Qwen3-235B-A22B-abliteratedMoEI1-IQ2_XXS235B57.55 GiB0.83 GiB59.31 GiB0.21 GiB71±37%
Mixtral-8x22B-Instruct-v0.1MoEQ3_K_S141B57.28 GiB0.98 GiB59.22 GiB0.30 GiB32±37%
Mixtral-8x22B-v0.1MoEQ3_K_S141B57.28 GiB0.98 GiB59.22 GiB0.30 GiB32±37%
Mixtral-8x22B-v0.1MoEQ3_K_S141B57.27 GiB0.98 GiB59.22 GiB0.30 GiB32±37%
GLM-4.6VMoEQ4_0108B57.48 GiB0.81 GiB59.22 GiB0.30 GiB71±37%
gemma-4-31B-itBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma4-Gutenberg-31BBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Wanabi-Gemma4-31BBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma4-Gutenberg-31B-HereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
G4-MeroMero-31B-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-it-Claude-Opus-Distill-v2BF1632.7B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-it-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma4-31B-Fable-5-DistilledF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Glistening-Gem-31B-v1.0BF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-31B-Fable-5-Agent-DistillBF1632.7B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
G4-MeroMero-31BBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
G4-Alice-v1.2-31BBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Equinox-31BBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-Gembrain-31B-it-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-31B-Storymaxxed3F1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-Harmonia-31B-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-MergemaxxedF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-it-qat-q4_0-unquantized-hereticF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-it-abliteratedF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-Garnet-V2-31B-it-ultra-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-Queen-31B-it-uncensored-hereticBF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Gemma-4-31B-storymaxxed2F1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-it-SDFT-Heretic-RPBF1630.7B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31B-anthologyF1631.3B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
gemma-4-31BBF1632.7B57.20 GiB1.03 GiB59.21 GiB0.31 GiB18±26.5%
Hypernova-60B-2605MoEQ8_058.7B58.13 GiB0.15 GiB59.17 GiB0.35 GiB84±37%
command-a-plus-05-2026-bf16MoEIQ2_XXS219B57.98 GiB0.26 GiB59.14 GiB0.38 GiB76±37%
Qwen3.5-88BMoEI1-Q5_K_M87.7B58.10 GiB0.11 GiB59.14 GiB0.38 GiB88±37%
Devstral-2-123B-Instruct-2512Q3_K_M125B56.46 GiB1.55 GiB59.06 GiB0.46 GiB18±26.5%
Mistral-Medium-3.5-128BI1-Q3_K_M128B56.46 GiB1.55 GiB59.06 GiB0.46 GiB18±26.5%
XORTRON-NXTXPRTXXLI1-Q3_K_M128B56.46 GiB1.55 GiB59.06 GiB0.46 GiB18±26.5%
GLM-4.7-REAP-218B-A32BMoEUD-IQ1_S218B56.46 GiB1.62 GiB59.01 GiB0.51 GiB59±37%
Llama-4-Scout-17B-16E-InstructMoEKV unresolvedQ4_K_S109B57.23 GiB0.84 GiB59.00 GiB0.52 GiB71±37%
dots.llm1.instMoEIQ2_M143B53.68 GiB4.36 GiB58.97 GiB0.55 GiB56±37%
Qwen3.5-99BMoEI1-Q4_199.0B57.88 GiB0.11 GiB58.91 GiB0.61 GiB92±37%
Assistant_Pepe_70BQ6_K_L70.6B56.43 GiB1.41 GiB58.86 GiB0.66 GiB18±26.5%
MiniMax-M2.1-REAP-139B-A10BMoEI1-IQ3_M139B56.81 GiB1.09 GiB58.79 GiB0.73 GiB74±37%
m51Lab-MiniMax-M2.7-REAP-139B-A10BMoEI1-IQ3_M139B56.81 GiB1.09 GiB58.79 GiB0.73 GiB74±37%
NVIDIA-Nemotron-3-Super-120B-A12B-BF16MoEUD-Q3_K_M124B57.47 GiB0.39 GiB58.76 GiB0.76 GiB86±37%
Qwen3.5-122B-A10BMoEUD-IQ4_XS125B57.67 GiB0.11 GiB58.71 GiB0.81 GiB99±37%
MiniMax-M2.7MoEIQ2_XXS229B56.67 GiB1.09 GiB58.64 GiB0.88 GiB86±37%
DeepSeek-Coder-V2-Instruct-0724MoEIQ2_XXS236B57.28 GiB0.30 GiB58.51 GiB1.01 GiB91±37%
DeepSeek-V2.5MoEIQ2_XXS236B57.28 GiB0.30 GiB58.51 GiB1.01 GiB91±37%
DeepSeek-Coder-V2-InstructMoEIQ2_XXS236B57.28 GiB0.30 GiB58.51 GiB1.01 GiB91±37%
GLM-4.5-Air-DerestrictedMoEIQ4_XS110B56.63 GiB0.81 GiB58.37 GiB1.15 GiB72±37%
GLM-4.5-AirMoEIQ4_XS110B56.63 GiB0.81 GiB58.37 GiB1.15 GiB72±37%
Qwen3-Coder-30B-A3B-InstructMoEBF1630.5B56.90 GiB0.42 GiB58.22 GiB1.30 GiB75±37%
Salience-1.5-FlashMoEBF1631.1B56.90 GiB0.42 GiB58.22 GiB1.30 GiB75±37%
Qwen3-VL-30B-A3B-InstructMoEBF1631.1B56.90 GiB0.42 GiB58.22 GiB1.30 GiB75±37%
●From the file◐Predictedwhat these mean

Speed is modeled, not measured: decode is memory-bandwidth bound, so tokens per second is bytes read per token against achievable bandwidth. Mixture-of-experts models carry a wider band because only the routed experts are read each step, and few have been measured publicly.

Questions people ask

What AI models can a Instinct MI210 run?
2062 of 2118 indexed open-weight models fit a Instinct MI210 at 16,384 context with q4_0 KV cache, the largest being gpt-oss-120b at Q4_K_M. That covers text, vision-language, image, video and speech models.
How much usable memory does a Instinct MI210 actually have?
Its nameplate is 64 GB, but about 59.52 GiB is available to a model once driver and compositor overhead is accounted for.
Is a Instinct MI210 fast for local AI?
Its memory bandwidth is 1638 GB/s, and that figure — not teraflops — is what governs token generation speed. Capacity decides what you can run; bandwidth decides how fast it runs.