MiniMaxAI · text · mixture of experts

MiniMax-M2.5

MiniMaxAI/MiniMax-M2.5

MiniMax-M2.5 at Q4_K_M is exactly 138,342,384,064 bytes (128.84 GiB / 138.34 GB) — an effective 4.839 bits per weight, not the nominal 4. Its KV cache at 32K is 7.75 GiB.

From the file· summed from 4 file(s)From the file· KV per layer
Parameters
229B
total, not active
Architecture
minimax-m2
62 layers
Context
196,608
native (config.json)
License
other

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-IQ1_S43.32 GiB46,514,882,4961.627mradermacher
I1-IQ1_M48.07 GiB51,614,648,2561.806mradermacher
UD-TQ1_051.94 GiB55,765,943,4241.951unsloth
I1-IQ2_XXS55.99 GiB60,114,257,8562.103mradermacher
UD-IQ1_S3 shards58.86 GiB63,202,444,7682.211unsloth
I1-IQ2_XS62.35 GiB66,950,514,6242.342mradermacher
I1-IQ2_S63.36 GiB68,036,279,2322.380mradermacher
UD-IQ1_M3 shards63.74 GiB68,439,344,6082.394unsloth
UD-IQ2_XXS3 shards69.03 GiB74,123,085,2802.593unsloth
I1-IQ2_M69.70 GiB74,835,966,9122.618mradermacher
I1-Q2_K_S72.23 GiB77,559,270,3362.713mradermacher
UD-IQ2_M3 shards72.83 GiB78,199,948,7362.735unsloth
I1-Q2_K77.58 GiB83,302,681,5362.914mradermacher
Q2_K3 shards77.58 GiB83,302,682,0802.914unsloth
Q2_K_L3 shards77.72 GiB83,446,728,1282.919unsloth
I1-IQ3_XXS81.91 GiB87,953,652,6723.077mradermacher
UD-IQ3_XXS3 shards86.91 GiB93,315,761,6323.264unsloth
I1-IQ3_XS86.92 GiB93,329,932,2243.265mradermacher
I1-Q3_K_S91.91 GiB98,690,596,8003.452mradermacher
Q3_K_S3 shards91.91 GiB98,690,597,3443.452unsloth
I1-IQ3_S91.94 GiB98,716,499,9043.453mradermacher
I1-IQ3_M93.13 GiB99,994,943,4243.498mradermacher
I1-Q3_K_M101.77 GiB109,272,481,7283.822mradermacher
Q3_K_M4 shards101.77 GiB109,272,482,3683.822unsloth
I1-Q3_K_L110.22 GiB118,351,052,7364.140mradermacher
I1-IQ4_XS113.51 GiB121,879,917,5044.263mradermacher
IQ4_XS4 shards113.53 GiB121,899,124,3204.264unsloth
IQ4_NL4 shards120.14 GiB128,999,622,2084.512unsloth
I1-Q4_0120.61 GiB129,503,724,4804.530mradermacher
Q4_04 shards120.61 GiB129,503,725,1204.530unsloth
I1-Q4_K_S121.10 GiB130,033,779,6484.549mradermacher
Q4_K_S4 shards121.10 GiB130,033,780,3204.549unsloth
Q4_K_M4 shards128.84 GiB138,342,384,0644.839lmstudio-community
I1-Q4_K_M128.84 GiB138,342,384,5764.839mradermacher
Q4_K_M4 shards128.84 GiB138,342,385,2164.839unsloth
I1-Q4_1133.39 GiB143,226,840,0005.010mradermacher
Q4_14 shards133.39 GiB143,226,840,6725.010unsloth
I1-Q5_K_S146.66 GiB157,478,437,8245.509mradermacher
Q5_K_S5 shards146.66 GiB157,478,438,5925.509unsloth
I1-Q5_K_M151.16 GiB162,303,935,4245.677mradermacher

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.97 GiB0.97 GiB62 / 0 / 0
8,1921.94 GiB1.94 GiB62 / 0 / 0
16,3843.88 GiB3.88 GiB62 / 0 / 0
32,7687.75 GiB7.75 GiB62 / 0 / 0
65,53615.50 GiB15.50 GiB62 / 0 / 0
131,07231.00 GiB31.00 GiB62 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 119.81 GiB. The real file is 128.84 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
62
Attention heads
48
KV heads
8
Head dim
128
Hidden size
3072
Vocab
200,064
Sliding window
none
SWA period
MLA
no
Experts
256
Experts per token
8
use_sliding_window

Questions people ask

How much VRAM does MiniMax-M2.5 need?
Q4_K_M is exactly 138,342,384,064 bytes (128.84 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is MiniMax-M2.5's KV cache?
7.75 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Is MiniMax-M2.5 a mixture-of-experts model?
Yes — 256 experts, 8 routed per token. Every expert must be resident, but only the routed ones are read per token, which is why its memory requirement and its speed behave very differently.
Which quantization of MiniMax-M2.5 should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.