Model comparison

DeepSeek-R1-Distill-Qwen-32B-abliterated-v2 vs Qwen3-Coder-30B-A3B-Instruct

At Q4_K_M, Qwen3-Coder-30B-A3B-Instruct is the smaller download — 18,556,689,568 bytes against 19,851,336,192.

From the file· summed bytes, KV per layer

Side by side

DeepSeek-R1-Distill-Qwen-32B-abliterated-v2Qwen3-Coder-30B-A3B-Instruct
Parameters32.8B30.5B
Architectureqwen2qwen3moe
Layers48
Native context262,144
Mixture of expertsnoyes, 128 experts
Quantizations published3446
Smallest quantization6.77 GiB7.46 GiB
Q4_K_M18.49 GiB17.28 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextDeepSeek-R1-Distill-Qwen-32B-abliterated-v2Qwen3-Coder-30B-A3B-InstructRatio
4,0960.38 GiB
8,1920.75 GiB
16,3841.50 GiB
32,7683.00 GiB
65,5366.00 GiB
131,07212.00 GiB