Model comparison

SmolLM2-1.7B-Instruct vs HyperCLOVAX-SEED-Text-Instruct-1.5B

At Q4_K_M, SmolLM2-1.7B-Instruct is the smaller download — 1,055,609,536 bytes against 1,133,974,368.

From the file· summed bytes, KV per layer

Side by side

SmolLM2-1.7B-InstructHyperCLOVAX-SEED-Text-Instruct-1.5B
Parameters1.7B1.6B
Architecturellamallama
Layers24
Native context8,192
Mixture of expertsnono
Quantizations published241
Smallest quantization0.63 GiB1.06 GiB
Q4_K_M0.98 GiB1.06 GiB
Licenceapache-2.0other

KV cache by context

the term that decides long-context viability
ContextSmolLM2-1.7B-InstructHyperCLOVAX-SEED-Text-Instruct-1.5BRatio
4,0960.75 GiB
8,1921.50 GiB
16,3843.00 GiB
32,7686.00 GiB
65,53612.00 GiB
131,07224.00 GiB