Model comparison

Supertron2-Reranker-2B vs gemma-3-1b-it

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: gemma-3-1b-it's KV cache at 32K is 23.9× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Supertron2-Reranker-2Bgemma-3-1b-it
Parameters2.1B1000M
Architectureqwen3vlgemma3
Layers2826
Native context262,14432,768
Mixture of expertsnono
Quantizations published2428
Smallest quantization0.48 GiB0.52 GiB
Q4_K_M0.75 GiB
Licenceapache-2.0gemma

KV cache by context

the term that decides long-context viability
ContextSupertron2-Reranker-2Bgemma-3-1b-itRatio
4,0960.44 GiB0.04 GiB11.79×
8,1920.88 GiB0.05 GiB16.59×
16,3841.75 GiB0.08 GiB20.84×
32,7683.50 GiB0.15 GiB23.89×
65,5367.00 GiB0.27 GiB25.78×
131,07214.00 GiB0.52 GiB26.85×
Supertron2-Reranker-2B vs gemma-3-1b-it — size, memory and hardware fit — ossmodeldb