Model comparison

Qwen3.6-27B vs NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

At Q4_K_M, Qwen3.6-27B is the smaller download — 16,547,397,888 bytes against 22,421,827,488. At long context the gap widens: NVIDIA-Nemotron-3-Nano-30B-A3B-BF16's KV cache at 32K is 1.2× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Qwen3.6-27BNVIDIA-Nemotron-3-Nano-30B-A3B-BF16
Parameters27.8B31.6B
Architectureqwen35nemotron_h_moe
Layers6452
Native context262,144262,144
Mixture of expertsnoyes, 128 experts
Quantizations published4025
Smallest quantization8.74 GiB16.85 GiB
Q4_K_M15.41 GiB20.88 GiB
Licenceapache-2.0other

KV cache by context

the term that decides long-context viability
ContextQwen3.6-27BNVIDIA-Nemotron-3-Nano-30B-A3B-BF16Ratio
4,0960.25 GiB0.20 GiB1.23×
8,1920.50 GiB0.41 GiB1.23×
16,3841.00 GiB0.81 GiB1.23×
32,7682.00 GiB1.63 GiB1.23×
65,5364.00 GiB3.25 GiB1.23×
131,0728.00 GiB6.50 GiB1.23×