Quantization publisher

neuphonic

neuphonic publishes 2 quantizations across 1 models in our index, averaging 7.111 effective bits per weight. Their files differ in size from other publishers' builds of the same nominal quantization on 2 of the pairs we can compare — the same label does not mean the same file.

From the file· summed file bytes
Repositories
2
Quantizations
2
Models covered
1
Avg effective bpw
7.111
across their files

Same model, same quant label, different bytes

largest disagreements first
ModelQuantneuphonicvsTheirsDifference
neutts-airQ8_00.75 GiBabliter8-ai0.55 GiB+34.8%
neutts-airQ8_00.75 GiBabliter8-ai0.55 GiB+34.8%

A quantization label describes a target, not a recipe. Publishers make different choices about which tensors to keep at higher precision, and some apply an importance matrix while others don't — so two files both honestly labelled the same thing can differ measurably in size and in quality.

Models they publish

ModelQuantizationsSmallest
neutts-air20.49 GiB