MiniMaxAI · text · mixture of experts

MiniMax-M2.7

MiniMaxAI/MiniMax-M2.7

MiniMax-M2.7 at Q4_K_M is exactly 138,342,384,096 bytes (128.84 GiB / 138.34 GB) — an effective 4.839 bits per weight, not the nominal 4. Its KV cache at 32K is 7.75 GiB.

From the file· summed from 4 file(s)From the file· KV per layer
Parameters
229B
total, not active
Architecture
minimax-m2
62 layers
Context
204,800
native (config.json)
License
other

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
IQ1_S43.47 GiB46,670,399,0081.633bartowski
IQ1_M2 shards48.62 GiB52,200,589,0241.826bartowski
UD-IQ1_M3 shards56.53 GiB60,700,770,4962.123unsloth
IQ2_XXS2 shards56.67 GiB60,845,049,5682.128bartowski
UD-IQ2_XXS3 shards60.89 GiB65,381,613,7602.287unsloth
IQ2_XS2 shards63.21 GiB67,866,314,4962.374bartowski
IQ2_S2 shards64.38 GiB69,131,975,4242.418bartowski
UD-IQ2_M3 shards65.32 GiB70,139,281,6002.454unsloth
IQ2_M2 shards71.17 GiB76,417,481,4402.673bartowski
Q2_K3 shards74.55 GiB80,051,669,8562.800bartowski
UD-IQ3_XXS3 shards74.60 GiB80,103,688,3842.802unsloth
Q2_K_L3 shards75.11 GiB80,651,861,8562.821bartowski
UD-IQ3_S3 shards77.87 GiB83,614,320,8002.925unsloth
UD-Q3_K_S3 shards87.21 GiB93,637,298,3683.275unsloth
IQ3_XXS3 shards88.65 GiB95,183,862,6563.329bartowski
Q3_K_S3 shards92.49 GiB99,314,040,6723.474bartowski
UD-Q3_K_M4 shards94.29 GiB101,243,668,7683.542unsloth
Q3_K_M3 shards96.98 GiB104,127,004,5123.642bartowski
IQ3_XS3 shards96.98 GiB104,127,004,5123.642bartowski
UD-IQ4_XS4 shards100.97 GiB108,413,781,3123.792unsloth
Q3_K_L3 shards101.05 GiB108,501,434,2403.795bartowski
IQ3_M3 shards101.33 GiB108,803,129,1843.806bartowski
UD-IQ4_NL4 shards103.15 GiB110,754,202,9123.874unsloth
IQ4_XS4 shards114.00 GiB122,403,189,7604.282bartowski
IQ4_NL4 shards120.57 GiB129,462,535,1364.529bartowski
Q4_04 shards120.93 GiB129,844,741,0884.542bartowski
UD-Q4_K_S4 shards121.97 GiB130,959,213,8884.581unsloth
Q4_K_S4 shards124.65 GiB133,846,107,1044.682bartowski
Q4_K_M4 shards128.84 GiB138,342,384,0964.839lmstudio-community
Q4_K_M4 shards129.27 GiB138,805,347,2964.855bartowski
Q4_K_L4 shards129.70 GiB139,261,493,2164.871bartowski
UD-Q4_K_M4 shards130.54 GiB140,169,905,5044.903unsloth
Q4_14 shards133.65 GiB143,508,087,7765.020bartowski
Q5_K_S4 shards146.87 GiB157,699,916,7685.516bartowski
UD-Q5_K_S5 shards148.12 GiB159,042,126,2725.563unsloth
Q5_K_M5 shards151.50 GiB162,668,299,3605.690bartowski
UD-Q5_K_M5 shards157.23 GiB168,828,486,0805.906unsloth
Q6_K5 shards174.87 GiB187,763,082,8806.568lmstudio-community
UD-Q6_K5 shards175.15 GiB188,060,778,9126.578unsloth
Q6_K5 shards183.52 GiB197,054,679,1686.893bartowski

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.97 GiB0.97 GiB62 / 0 / 0
8,1921.94 GiB1.94 GiB62 / 0 / 0
16,3843.88 GiB3.88 GiB62 / 0 / 0
32,7687.75 GiB7.75 GiB62 / 0 / 0
65,53615.50 GiB15.50 GiB62 / 0 / 0
131,07231.00 GiB31.00 GiB62 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 119.81 GiB. The real file is 128.84 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
62
Attention heads
48
KV heads
8
Head dim
128
Hidden size
3072
Vocab
200,064
Sliding window
none
SWA period
MLA
no
Experts
256
Experts per token
8
use_sliding_window

Questions people ask

How much VRAM does MiniMax-M2.7 need?
Q4_K_M is exactly 138,342,384,096 bytes (128.84 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is MiniMax-M2.7's KV cache?
7.75 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Is MiniMax-M2.7 a mixture-of-experts model?
Yes — 256 experts, 8 routed per token. Every expert must be resident, but only the routed ones are read per token, which is why its memory requirement and its speed behave very differently.
Which quantization of MiniMax-M2.7 should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.