Model comparison

llama-joycaption-beta-one-hf-llava vs HyperCLOVAX-SEED-Text-Instruct-1.5B

At Q4_K_M, HyperCLOVAX-SEED-Text-Instruct-1.5B is the smaller download — 1,133,974,368 bytes against 4,920,736,064.

From the file· summed bytes, KV per layer

Side by side

llama-joycaption-beta-one-hf-llavaHyperCLOVAX-SEED-Text-Instruct-1.5B
Parameters8.5B1.6B
Architecturellamallama
Layers32
Native context131,072
Mixture of expertsnono
Quantizations published371
Smallest quantization1.88 GiB1.06 GiB
Q4_K_M4.58 GiB1.06 GiB
Licenceother

KV cache by context

the term that decides long-context viability
Contextllama-joycaption-beta-one-hf-llavaHyperCLOVAX-SEED-Text-Instruct-1.5BRatio
4,0960.50 GiB
8,1921.00 GiB
16,3842.00 GiB
32,7684.00 GiB
65,5368.00 GiB
131,07216.00 GiB