Model comparison

next-1b vs Llama-3.2-1B-Instruct

At Q4_K_M, next-1b is the smaller download — 806,057,664 bytes against 807,690,688. At long context the gap widens: next-1b's KV cache at 32K is 6.8× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

next-1bLlama-3.2-1B-Instruct
Parameters1000M1.2B
Architecturegemma3llama
Layers2616
Native context32,768131,072
Mixture of expertsnono
Quantizations published139
Smallest quantization0.75 GiB0.39 GiB
Q4_K_M0.75 GiB0.75 GiB
Licencemit

KV cache by context

the term that decides long-context viability
Contextnext-1bLlama-3.2-1B-InstructRatio
4,0960.04 GiB0.13 GiB3.37×
8,1920.05 GiB0.25 GiB4.74×
16,3840.08 GiB0.50 GiB5.95×
32,7680.15 GiB1.00 GiB6.83×
65,5360.27 GiB2.00 GiB7.37×
131,0720.52 GiB4.00 GiB7.67×
next-1b vs Llama-3.2-1B-Instruct — size, memory and hardware fit — ossmodeldb