Quantization publisher

Undi95

Undi95 publishes 2 quantizations across 1 models in our index, averaging 6.695 effective bits per weight. Their files differ in size from other publishers' builds of the same nominal quantization on 2 of the pairs we can compare — the same label does not mean the same file.

From the file· summed file bytes
Repositories
1
Quantizations
2
Models covered
1
Avg effective bpw
6.695
across their files

Same model, same quant label, different bytes

largest disagreements first
ModelQuantUndi95vsTheirsDifference
Lumimaid-v0.2-12BQ8_012.13 GiBbartowski12.13 GiB-0.0%
Lumimaid-v0.2-12BQ4_K_M6.96 GiBbartowski6.96 GiB-0.0%

A quantization label describes a target, not a recipe. Publishers make different choices about which tensors to keep at higher precision, and some apply an importance matrix while others don't — so two files both honestly labelled the same thing can differ measurably in size and in quality.

Models they publish

ModelQuantizationsSmallest
Lumimaid-v0.2-12B26.96 GiB