dervig · text · mixture of experts

m51Lab-MiniMax-M2.7-REAP-139B-A10B

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B

m51Lab-MiniMax-M2.7-REAP-139B-A10B at Q4_K_M is exactly 84,186,489,920 bytes (78.40 GiB / 84.19 GB) — an effective 4.840 bits per weight, not the nominal 4. Its KV cache at 32K is 7.75 GiB.

From the file· summed from 1 file(s)From the file· KV per layer
Parameters
139B
total, not active
Architecture
minimax-m2
62 layers
Context
196,608
native (config.json)
License
other

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-IQ1_S26.55 GiB28,505,099,3921.639mradermacher
I1-IQ1_M29.42 GiB31,585,676,4161.816mradermacher
I1-IQ2_XXS34.20 GiB36,719,971,4562.111mradermacher
I1-IQ2_XS38.06 GiB40,863,976,5762.349mradermacher
I1-IQ2_S38.75 GiB41,607,569,5362.392mradermacher
I1-IQ2_M42.58 GiB45,715,005,5682.628mradermacher
I1-Q2_K_S44.07 GiB47,317,790,8482.720mradermacher
I1-Q2_K47.33 GiB50,820,165,7602.922mradermacher
I1-IQ3_XXS49.92 GiB53,606,113,4083.082mradermacher
I1-IQ3_XS53.00 GiB56,906,802,3043.272mradermacher
I1-Q3_K_S56.02 GiB60,146,754,6883.458mradermacher
I1-IQ3_S56.04 GiB60,172,657,7923.459mradermacher
I1-IQ3_M56.81 GiB61,003,646,0803.507mradermacher
Q3_K_M62.01 GiB66,584,977,4723.828dervig
I1-Q3_K_M62.01 GiB66,584,978,5603.828mradermacher
I1-Q3_K_L67.16 GiB72,113,988,7364.146mradermacher
IQ4_XS69.15 GiB74,244,084,8004.269dervig
I1-IQ4_XS69.15 GiB74,244,085,8884.269mradermacher
I1-Q4_073.44 GiB78,859,790,4644.534mradermacher
I1-Q4_K_S73.74 GiB79,179,278,4644.552mradermacher
Q4_K_M78.40 GiB84,186,489,9204.840dervig
I1-Q4_K_M78.40 GiB84,186,491,0084.840mradermacher
I1-Q4_181.21 GiB87,198,402,6885.013mradermacher
I1-Q5_K_S89.27 GiB95,854,930,0485.511mradermacher
I1-Q5_K_M91.98 GiB98,762,762,3685.678mradermacher
Q6_K106.40 GiB114,250,049,6006.569dervig
Q8_0137.78 GiB147,942,940,7368.506dervig

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.97 GiB0.97 GiB62 / 0 / 0
8,1921.94 GiB1.94 GiB62 / 0 / 0
16,3843.88 GiB3.88 GiB62 / 0 / 0
32,7687.75 GiB7.75 GiB62 / 0 / 0
65,53615.50 GiB15.50 GiB62 / 0 / 0
131,07231.00 GiB31.00 GiB62 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 72.90 GiB. The real file is 78.40 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
62
Attention heads
48
KV heads
8
Head dim
128
Hidden size
3072
Vocab
200,064
Sliding window
none
SWA period
MLA
no
Experts
154
Experts per token
8
use_sliding_window

Questions people ask

How much VRAM does m51Lab-MiniMax-M2.7-REAP-139B-A10B need?
Q4_K_M is exactly 84,186,489,920 bytes (78.40 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is m51Lab-MiniMax-M2.7-REAP-139B-A10B's KV cache?
7.75 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Is m51Lab-MiniMax-M2.7-REAP-139B-A10B a mixture-of-experts model?
Yes — 154 experts, 8 routed per token. Every expert must be resident, but only the routed ones are read per token, which is why its memory requirement and its speed behave very differently.
Which quantization of m51Lab-MiniMax-M2.7-REAP-139B-A10B should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.