Model comparison

gemma-4-12B-it vs glm-4v-9b

At Q4_K_M, glm-4v-9b is the smaller download — 6,166,574,560 bytes against 7,121,861,440.

From the file· summed bytes, KV per layer

Side by side

gemma-4-12B-itglm-4v-9b
Parameters12.0B13.9B
Architecturegemma4glm4
Layers48
Native context262,144
Mixture of expertsnono
Quantizations published5914
Smallest quantization3.92 GiB3.73 GiB
Q4_K_M6.63 GiB5.74 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
Contextgemma-4-12B-itglm-4v-9bRatio
4,0960.72 GiB
8,1920.97 GiB
16,3841.47 GiB
32,7682.47 GiB
65,5364.47 GiB
131,0728.47 GiB