Model comparison

LFM2-2.6B-Transcript vs Qwen3-VL-8B-Instruct-abliterated-v1

At Q4_K_M, LFM2-2.6B-Transcript is the smaller download — 1,563,669,248 bytes against 5,027,785,792.

From the file· summed bytes, KV per layer

Side by side

LFM2-2.6B-TranscriptQwen3-VL-8B-Instruct-abliterated-v1
Parameters2.6B8.8B
Architecturelfm2qwen3vl
Layers30
Native context128,000
Mixture of expertsnono
Quantizations published1148
Smallest quantization0.92 GiB1.97 GiB
Q4_K_M1.46 GiB4.68 GiB
Licenceapache-2.0

KV cache by context

the term that decides long-context viability
ContextLFM2-2.6B-TranscriptQwen3-VL-8B-Instruct-abliterated-v1Ratio
4,0960.06 GiB
8,1920.13 GiB
16,3840.25 GiB
32,7680.50 GiB
65,5361.00 GiB
131,0722.00 GiB
LFM2-2.6B-Transcript vs Qwen3-VL-8B-Instruct-abliterated-v1 — size, memory and hardware fit — ossmodeldb