Model comparison

aya-expanse-8b vs Qwen3-8B

At Q4_K_M, Qwen3-8B is the smaller download — 5,027,783,488 bytes against 5,056,982,464.

From the file· summed bytes, KV per layer

Side by side

aya-expanse-8bQwen3-8B
Parameters8.0B8.2B
Architecturecommand-rqwen3
Layers36
Native context40,960
Mixture of expertsnono
Quantizations published2451
Smallest quantization2.87 GiB2.12 GiB
Q4_K_M4.71 GiB4.68 GiB
Licencecc-by-nc-4.0apache-2.0

KV cache by context

the term that decides long-context viability
Contextaya-expanse-8bQwen3-8BRatio
4,0960.56 GiB
8,1921.13 GiB
16,3842.25 GiB
32,7684.50 GiB
65,5369.00 GiB
131,07218.00 GiB