Model comparison

Falcon3-1B-Instruct vs Qwen3-1.7B

At Q4_K_M, Falcon3-1B-Instruct is the smaller download — 1,057,044,608 bytes against 1,107,409,472. At long context the gap widens: Falcon3-1B-Instruct's KV cache at 32K is 1.6× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Falcon3-1B-InstructQwen3-1.7B
Parameters1.7B2.0B
Architecturellamaqwen3
Layers1828
Native context8,19240,960
Mixture of expertsnono
Quantizations published3048
Smallest quantization0.21 GiB0.50 GiB
Q4_K_M0.98 GiB1.03 GiB
Licenceother

KV cache by context

the term that decides long-context viability
ContextFalcon3-1B-InstructQwen3-1.7BRatio
4,0960.28 GiB0.44 GiB1.56×
8,1920.56 GiB0.88 GiB1.56×
16,3841.13 GiB1.75 GiB1.56×
32,7682.25 GiB3.50 GiB1.56×
65,5364.50 GiB7.00 GiB1.56×
131,0729.00 GiB14.00 GiB1.56×