Model comparison

Qwen3.5-4B vs Qwen3.5-2B-enko

At Q4_K_M, Qwen3.5-2B-enko is the smaller download — 1,100,563,648 bytes against 2,707,513,696. At long context the gap widens: Qwen3.5-2B-enko's KV cache at 32K is 2.7× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Qwen3.5-4BQwen3.5-2B-enko
Parameters4.7B2.1B
Architectureqwen35qwen35
Layers3224
Native context262,144262,144
Mixture of expertsnono
Quantizations published574
Smallest quantization1.42 GiB0.82 GiB
Q4_K_M2.52 GiB1.02 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
ContextQwen3.5-4BQwen3.5-2B-enkoRatio
4,0960.13 GiB0.05 GiB2.67×
8,1920.25 GiB0.09 GiB2.67×
16,3840.50 GiB0.19 GiB2.67×
32,7681.00 GiB0.38 GiB2.67×
65,5362.00 GiB0.75 GiB2.67×
131,0724.00 GiB1.50 GiB2.67×
Qwen3.5-4B vs Qwen3.5-2B-enko — size, memory and hardware fit — ossmodeldb