Quantization publisher
legraphista
legraphista publishes 1,122 quantizations across 47 models in our index, averaging 4.563 effective bits per weight. Their files differ in size from other publishers' builds of the same nominal quantization on 25 of the pairs we can compare — the same label does not mean the same file.
From the file· summed file bytes
Repositories
48
Quantizations
1,122
Models covered
47
Avg effective bpw
4.563
across their files
Same model, same quant label, different bytes
largest disagreements first
| Model | Quant | legraphista | vs | Theirs | Difference |
|---|---|---|---|---|---|
| c4ai-command-r-plus-08-2024 | Q8_0 | 80.54 GiB | bartowski | 102.74 GiB | -21.6% |
| Llama-Guard-3-8B | Q8_0 | 7.95 GiB | eaddario | 7.20 GiB | +10.4% |
| Llama-Guard-3-8B | Q3_K_L | 4.03 GiB | eaddario | 3.50 GiB | +15.0% |
| Llama-Guard-3-8B | Q4_K_S | 4.37 GiB | eaddario | 3.99 GiB | +9.7% |
| Llama-Guard-3-8B | Q3_K_S | 3.41 GiB | eaddario | 3.08 GiB | +10.9% |
| Llama-Guard-3-8B | Q5_K_S | 5.21 GiB | eaddario | 4.88 GiB | +6.8% |
| Llama-Guard-3-8B | IQ4_NL | 4.36 GiB | eaddario | 4.09 GiB | +6.4% |
| Llama-Guard-3-8B | IQ3_S | 3.43 GiB | eaddario | 3.20 GiB | +7.3% |
| shieldgemma-27b | IQ4_XS | 13.80 GiB | mradermacher | 13.92 GiB | -0.9% |
| Llama-Guard-3-8B | IQ3_M | 3.52 GiB | eaddario | 3.43 GiB | +2.7% |
| DeepSeek-Coder-V2-Lite-Instruct | IQ4_XS | 7.98 GiB | mradermacher | 8.05 GiB | -0.9% |
| codegeex4-all-9b | IQ4_XS | 4.89 GiB | mradermacher | 4.94 GiB | -1.0% |
| glm-4-9b-chat | IQ4_XS | 4.94 GiB | bartowski | 4.89 GiB | +1.0% |
| glm-4-9b-chat-1m | IQ4_XS | 4.98 GiB | bartowski | 4.93 GiB | +1.0% |
| Llama3-ChatQA-1.5-8B | IQ4_XS | 4.14 GiB | PrunaAI | 4.18 GiB | -0.8% |
| Llama-Guard-3-8B | IQ4_XS | 4.14 GiB | mradermacher | 4.18 GiB | -0.8% |
| Mistral-7B-v0.3 | IQ4_XS | 3.64 GiB | mradermacher | 3.68 GiB | -0.9% |
| Llama3-ChatQA-1.5-8B | IQ4_NL | 4.36 GiB | PrunaAI | 4.38 GiB | -0.6% |
| Llama-Guard-3-8B | Q6_K | 6.14 GiB | eaddario | 6.12 GiB | +0.4% |
| Llama-3.1-Minitron-4B-Width-Base | IQ4_XS | 2.38 GiB | bartowski | 2.36 GiB | +0.7% |
| Llama3-ChatQA-1.5-8B | Q5_K_S | 5.21 GiB | QuantFactory | 5.22 GiB | -0.0% |
| Llama3-ChatQA-1.5-8B | Q6_K | 6.14 GiB | QuantFactory | 6.14 GiB | -0.0% |
| Llama3-ChatQA-1.5-8B | Q8_0 | 7.95 GiB | QuantFactory | 7.95 GiB | -0.0% |
| Llama3-ChatQA-1.5-8B | Q3_K_L | 4.03 GiB | QuantFactory | 4.03 GiB | -0.0% |
| Llama3-ChatQA-1.5-8B | Q3_K_S | 3.41 GiB | QuantFactory | 3.41 GiB | -0.0% |
A quantization label describes a target, not a recipe. Publishers make different choices about which tensors to keep at higher precision, and some apply an importance matrix while others don't — so two files both honestly labelled the same thing can differ measurably in size and in quality.
Models they publish
| Model | Quantizations | Smallest |
|---|---|---|
| Codestral-22B-v0.1 | 24 | 4.50 GiB |
| DeepSeek-Coder-V2-Lite-Instruct | 24 | 4.65 GiB |
| Hermes-3-Llama-3.1-8B | 24 | 1.88 GiB |
| Qwen2-0.5B-Instruct | 24 | 0.29 GiB |
| gemma-2-27b-it | 24 | 5.71 GiB |
| glm-4-9b-chat | 40 | 2.89 GiB |
| Qwen2.5-Math-1.5B-Instruct | 24 | 0.41 GiB |
| Phi-3-mini-4k-instruct | 24 | 0.78 GiB |
| Meta-Llama-3.1-8B-Instruct-abliterated | 24 | 1.88 GiB |
| Hermes-3-Llama-3.1-70B | 24 | 14.29 GiB |
| DeepSeek-V2-Lite-Chat | 24 | 4.65 GiB |
| openchat-3.6-8b-20240522 | 24 | 1.88 GiB |
| Phi-3-medium-128k-instruct | 24 | 2.75 GiB |
| DeepSeek-V2.5 | 23 | 44.14 GiB |
| Gemma-2-9B-It-SPPO-Iter3 | 24 | 2.22 GiB |
| granite-20b-code-instruct-8k | 24 | 4.21 GiB |
| glm-4-9b-chat-1m | 16 | 3.74 GiB |
| Yi-Coder-1.5B | 24 | 0.46 GiB |
| Qwen2-1.5B-Instruct | 24 | 0.41 GiB |
| Llama-3.1-Storm-8B | 24 | 1.88 GiB |
| DeepSeek-Coder-V2-Instruct-0724 | 23 | 44.14 GiB |
| Mistral-7B-v0.3 | 24 | 1.50 GiB |
| Llama-3.1-SuperNova-Lite | 24 | 1.88 GiB |
| xLAM-7b-r | 24 | 1.50 GiB |
| c4ai-command-r-plus-08-2024 | 23 | 21.59 GiB |
| Llama-Guard-3-8B | 24 | 1.88 GiB |
| Meta-Llama-3-8B-Instruct-abliterated-v3 | 24 | 1.88 GiB |
| Hermes-2-Theta-Llama-3-8B | 24 | 1.88 GiB |
| DeepSeek-Coder-V2-Lite-Base | 24 | 4.65 GiB |
| codegeex4-all-9b | 24 | 2.89 GiB |