Quantization format

I1_IQ4_NL

I1_IQ4_NL has a nominal rate of — bits per weight. We have no measured files carrying this label yet.

From the file· 528 files measured
Nominal bpw
—
from the block layout
Measured average
4.683
528 files
Range
1.131–9.321
varies by architecture
File sizes
0.10 GiB+
up to 38.48 GiB

Real files

one per model, most downloaded first
ModelSize●Effective bpw●vs nominal●
Qwen3-VL-8B-Instruct-abliterated-v14.46 GiB4.374—
Qwythos-9B-v25.17 GiB4.604—
Sugoi-14B-Ultra-HF7.96 GiB4.631—
gemma-4-12b-heretic-abliterated6.50 GiB4.666—
FastContext-1.0-4B-SFT2.22 GiB4.736—
Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning4.36 GiB4.660—
gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-uncensored-heretic6.50 GiB4.666—
Qwable-9B-Claude-Fable-55.05 GiB4.606—
Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW5.07 GiB4.712—
Qwen2.5-VL-7B-Instruct-abliterated4.13 GiB4.282—
Qwen3.5-9B-Claude-4.6-Opus-Deckard-V4.2-Uncensored-Heretic-Thinking5.05 GiB4.606—
Qwen3.5-9B-Claude-4.6-OS-Auto-Variable-HERETIC-UNCENSORED-THINKING4.95 GiB4.521—
gemma-4-12b-it-uncensored6.50 GiB4.666—
gemma-4-12B-coder-fable5-composer2.5-v1-uncensored-heretic6.50 GiB4.666—
Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-HERETIC-UNCENSORED4.95 GiB4.521—
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated5.17 GiB4.604—
Holo-3.1-9B5.05 GiB4.606—
Qwythos-9B-Claude-Mythos-5-1M-MTP5.17 GiB4.604—
Qwen3.5-DPO-4B-22.43 GiB4.964—
GLM-OCR0.49 GiB3.190—
Qwen3-14B-Uncensored7.95 GiB4.627—
olmOCR-2-7B-10254.13 GiB4.282—
Gemma-4-12B-it-AEON-Abliterated-K4-BF166.50 GiB4.666—
Holo-3.1-4B2.76 GiB4.587—
Garnet-OCR-3B-04221.86 GiB3.935—
●From the filewhat these mean

Other quantizations

Q2_KQ3_K_SQ3_K_MQ3_K_LQ4_0Q4_K_SQ4_K_MQ5_K_SQ5_K_MQ6_KQ8_0IQ4_XSIQ3_XXSIQ2_XXSF16BF16F32