Model comparison

Qwen3-VL-4B-Instruct-abliterated-v1 vs gemma-4-E2B-it

At Q4_K_M, Qwen3-VL-4B-Instruct-abliterated-v1 is the smaller download — 2,497,282,560 bytes against 3,106,738,272.

From the file· summed bytes, KV per layer

Side by side

Qwen3-VL-4B-Instruct-abliterated-v1gemma-4-E2B-it
Parameters4.4B5.1B
Architectureqwen3vlgemma4
Layers35
Native context131,072
Mixture of expertsnono
Quantizations published6054
Smallest quantization0.98 GiB2.13 GiB
Q4_K_M2.33 GiB2.89 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
ContextQwen3-VL-4B-Instruct-abliterated-v1gemma-4-E2B-itRatio
4,0960.05 GiB
8,1920.08 GiB
16,3840.14 GiB
32,7680.25 GiB
65,5360.46 GiB
131,0720.90 GiB