Model comparison

rfdetr vs gemma-4-E4B-it-assistant

These two publish different quantization sets; the table below has the exact sizes.

From the file· summed bytes, KV per layer

Side by side

rfdetrgemma-4-E4B-it-assistant
Parameters30M79M
Architecturerfdetrgemma4-assistant
Layers4
Native context131,072
Mixture of expertsnono
Quantizations published129
Smallest quantization0.03 GiB0.07 GiB
Q4_K_M0.07 GiB
Licenceapache-2.0apache-2.0

KV cache by context

the term that decides long-context viability
Contextrfdetrgemma-4-E4B-it-assistantRatio
4,0960.01 GiB
8,1920.02 GiB
16,3840.04 GiB
32,7680.07 GiB
65,5360.13 GiB
131,0720.26 GiB