Model comparison

Nanonets-OCR-s vs Qwen3.5-4B

At Q4_K_M, Nanonets-OCR-s is the smaller download — 1,929,900,800 bytes against 2,707,513,696.

From the file· summed bytes, KV per layer

Side by side

Nanonets-OCR-sQwen3.5-4B
Parameters3.8B4.7B
Architectureqwen2vlqwen35
Layers3632
Native context128,000262,144
Mixture of expertsnono
Quantizations published5657
Smallest quantization0.74 GiB1.42 GiB
Q4_K_M1.80 GiB2.52 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextNanonets-OCR-sQwen3.5-4BRatio
4,0960.14 GiB0.13 GiB1.12×
8,1920.28 GiB0.25 GiB1.12×
16,3840.56 GiB0.50 GiB1.12×
32,7681.13 GiB1.00 GiB1.12×
65,5362.25 GiB2.00 GiB1.12×
131,0724.50 GiB4.00 GiB1.12×