Model comparison

IQuest-Coder-V1-40B-Instruct vs gemma-4-E4B-it

These two publish different quantization sets; the table below has the exact sizes. At long context the gap widens: gemma-4-E4B-it's KV cache at 32K is 19.8× smaller, which usually matters more than the difference in weights.

From the file· summed bytes, KV per layer

Side by side

IQuest-Coder-V1-40B-Instructgemma-4-E4B-it
Parameters39.8B8.0B
Architecturellamagemma4
Layers8042
Native context131,072131,072
Mixture of expertsnono
Quantizations published2336
Smallest quantization7.91 GiB3.30 GiB
Q4_K_M4.64 GiB
Licenceotherapache-2.0

KV cache by context

the term that decides long-context viability
ContextIQuest-Coder-V1-40B-Instructgemma-4-E4B-itRatio
4,0961.25 GiB0.12 GiB10.16×
8,1922.50 GiB0.18 GiB14.07×
16,3845.00 GiB0.29 GiB17.41×
32,76810.00 GiB0.51 GiB19.77×
65,53620.00 GiB0.94 GiB21.20×
131,07240.00 GiB1.82 GiB22.00×