Model comparison

Qwen3.8-27B vs Phi-3-mini-4k-instruct

At Q4_K_M, Phi-3-mini-4k-instruct is the smaller download — 8,404,011,936 bytes against 16,810,714,336.

From the file· summed bytes, KV per layer

Side by side

Qwen3.8-27BPhi-3-mini-4k-instruct
Parameters27.8B3.8B
Architectureqwen35llama
Layers6432
Native context262,1444,096
Mixture of expertsnono
Quantizations published2236
Smallest quantization8.39 GiB3.91 GiB
Q4_K_M15.66 GiB7.83 GiB
Licenceapache-2.0mit

KV cache by context

the term that decides long-context viability
ContextQwen3.8-27BPhi-3-mini-4k-instructRatio
4,0960.25 GiB
8,1920.50 GiB
16,3841.00 GiB
32,7682.00 GiB
65,5364.00 GiB
131,0728.00 GiB