Model comparison

canary-1b-flash vs whisper-large-v3

At Q4_K_M, canary-1b-flash is the smaller download — 677,141,280 bytes against 997,303,008.

From the file· summed bytes, KV per layer

Side by side

canary-1b-flashwhisper-large-v3
Parameters811M1.5B
Architecturecanarywhisper
Layers32
Native context
Mixture of expertsnono
Quantizations published618
Smallest quantization0.63 GiB0.49 GiB
Q4_K_M0.63 GiB0.93 GiB
Licencecc-by-4.0apache-2.0

KV cache by context

the term that decides long-context viability
Contextcanary-1b-flashwhisper-large-v3Ratio
4,096
8,192
16,384
32,768
65,536
131,072
canary-1b-flash vs whisper-large-v3 — size, memory and hardware fit — ossmodeldb