Model comparison

nemotron-speech-streaming-en-0.6b vs parakeet-tdt-0.6b-v3

At Q4_K_M, nemotron-speech-streaming-en-0.6b is the smaller download — 475,436,032 bytes against 485,425,504.

From the file· summed bytes, KV per layer

Side by side

nemotron-speech-streaming-en-0.6bparakeet-tdt-0.6b-v3
Parameters618M627M
Architectureparakeetparakeet
Layers
Native context
Mixture of expertsnono
Quantizations published610
Smallest quantization0.44 GiB0.39 GiB
Q4_K_M0.44 GiB0.45 GiB
Licenceothercc-by-4.0

KV cache by context

the term that decides long-context viability
Contextnemotron-speech-streaming-en-0.6bparakeet-tdt-0.6b-v3Ratio
4,096
8,192
16,384
32,768
65,536
131,072