Model comparison

Qwen3.6-27B vs Nemotron-Cascade-2-30B-A3B-heretic-ara-uncensored

At Q4_K_M, Qwen3.6-27B is the smaller download — 16,547,397,888 bytes against 24,515,131,200. At long context the gap widens: Nemotron-Cascade-2-30B-A3B-heretic-ara-uncensored's KV cache at 32K is 1.2× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Qwen3.6-27BNemotron-Cascade-2-30B-A3B-heretic-ara-uncensored
Parameters27.8B31.6B
Architectureqwen35nemotron_h_moe
Layers6452
Native context262,144262,144
Mixture of expertsnoyes, 128 experts
Quantizations published4034
Smallest quantization8.74 GiB16.64 GiB
Q4_K_M15.41 GiB22.83 GiB
Licenceapache-2.0other

KV cache by context

the term that decides long-context viability
ContextQwen3.6-27BNemotron-Cascade-2-30B-A3B-heretic-ara-uncensoredRatio
4,0960.25 GiB0.20 GiB1.23×
8,1920.50 GiB0.41 GiB1.23×
16,3841.00 GiB0.81 GiB1.23×
32,7682.00 GiB1.63 GiB1.23×
65,5364.00 GiB3.25 GiB1.23×
131,0728.00 GiB6.50 GiB1.23×