Model comparison

Infinity-Parser2-Pro vs DeepSeek-V4-Flash

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: DeepSeek-V4-Flash's KV cache at 32K is 9.9× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

Infinity-Parser2-ProDeepSeek-V4-Flash
Parameters35.1B291B
Architectureqwen35moedeepseek4
Layers4043
Native context262,1441,048,576
Mixture of expertsyes, 256 expertsyes, 256 experts
Quantizations published112
Smallest quantization34.37 GiB76.87 GiB
Q4_K_M
Licenceapache-2.0mit

KV cache by context

the term that decides long-context viability
ContextInfinity-Parser2-ProDeepSeek-V4-FlashRatio
4,0960.08 GiB0.06 GiB1.24×
8,1920.16 GiB0.06 GiB2.48×
16,3840.31 GiB0.06 GiB4.96×
32,7680.63 GiB0.06 GiB9.92×
65,5361.25 GiB0.06 GiB19.85×
131,0722.50 GiB0.06 GiB39.69×