Model comparison

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B vs Qwen3-Coder-30B-A3B-Instruct

At Q4_K_M, Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B is the smaller download — 11,312,942,112 bytes against 18,556,689,568. At long context the gap widens: Qwen3-Coder-30B-A3B-Instruct's KV cache at 32K is 1.2× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4BQwen3-Coder-30B-A3B-Instruct
Parameters18.4B30.5B
Architecturellamaqwen3moe
Layers2848
Native context131,072262,144
Mixture of expertsyes, 8 expertsyes, 128 experts
Quantizations published3146
Smallest quantization6.56 GiB7.46 GiB
Q4_K_M10.54 GiB17.28 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
ContextLlama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4BQwen3-Coder-30B-A3B-InstructRatio
4,0960.44 GiB0.38 GiB1.17×
8,1920.88 GiB0.75 GiB1.17×
16,3841.75 GiB1.50 GiB1.17×
32,7683.50 GiB3.00 GiB1.17×
65,5367.00 GiB6.00 GiB1.17×
131,07214.00 GiB12.00 GiB1.17×