Model comparison

DeepSeek-V4-Flash vs Infinity-Parser2-Pro

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: DeepSeek-V4-Flash's KV cache at 32K is 9.9× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

DeepSeek-V4-FlashInfinity-Parser2-Pro
Parameters291B35.1B
Architecturedeepseek4qwen35moe
Layers4340
Native context1,048,576262,144
Mixture of expertsyes, 256 expertsyes, 256 experts
Quantizations published121
Smallest quantization76.87 GiB34.37 GiB
Q4_K_M
Licencemitapache-2.0

KV cache by context

the term that decides long-context viability
ContextDeepSeek-V4-FlashInfinity-Parser2-ProRatio
4,0960.06 GiB0.08 GiB1.24×
8,1920.06 GiB0.16 GiB2.48×
16,3840.06 GiB0.31 GiB4.96×
32,7680.06 GiB0.63 GiB9.92×
65,5360.06 GiB1.25 GiB19.85×
131,0720.06 GiB2.50 GiB39.69×