Model comparison

Pony_Diffusion_V6_XL vs FLUX.2-klein-9B

These two publish different quantization sets; the table below has the exact sizes.

From the file· summed bytes, KV per layer

Side by side

Pony_Diffusion_V6_XLFLUX.2-klein-9B
Parameters2.6B9.1B
Architecturesdxlflux
Layers
Native context
Mixture of expertsnono
Quantizations published229
Smallest quantization2.61 GiB3.71 GiB
Q4_K_M4.68 GiB
Licenceother

KV cache by context

the term that decides long-context viability
ContextPony_Diffusion_V6_XLFLUX.2-klein-9BRatio
4,096
8,192
16,384
32,768
65,536
131,072
Pony_Diffusion_V6_XL vs FLUX.2-klein-9B — size, memory and hardware fit — ossmodeldb