Qwen3-4B-Apollo-V0.1-4B-Thinking-Heretic-Abliterated alternatives

Qwen3-4B-Apollo-V0.1-4B-Thinking-Heretic-Abliterated's smallest published quantization is 17.30 GiB. The models below do the same job with a different trade — less memory, comparable size, or a more permissive licence.

From the file· sizes from summed file bytes

Meaningfully smaller

under 70% of its smallest quantization
ModelParamsSmallestQuantsLicence
Qwen3-Coder-30B-A3B-InstructMoE30.5B7.46 GiB46apache-2.0
Qwen3.6-27B27.8B8.74 GiB40apache-2.0
Qwen3.8-27B27.8B8.39 GiB22apache-2.0
gemma-4-12B-it-qat-q4_0-unquantized12.0B6.50 GiB2apache-2.0
gemma-4-E4B-it8.0B3.30 GiB36apache-2.0
Qwen3-30B-A3B-Thinking-2507MoE30.5B7.05 GiB51apache-2.0
Qwen3-4B4.0B1.01 GiB29
Qwen3-8B8.2B2.12 GiB51apache-2.0

Comparable in size

within ±40%, so a like-for-like swap
ModelParamsSmallestQuantsLicence
Laguna-S-2.1MoE118B23.15 GiB49
Qwen3-Coder-NextMoE79.7B15.44 GiB61apache-2.0
Agents-A1MoE35.1B19.71 GiB3apache-2.0

More permissively licensed

licences that allow commercial use
ModelParamsSmallestQuantsLicence
Qwen3-Coder-30B-A3B-InstructMoE30.5B7.46 GiB46apache-2.0
Qwen3.6-27B27.8B8.74 GiB40apache-2.0
Qwen3.8-27B27.8B8.39 GiB22apache-2.0
DeepSeek-V4-FlashMoE291B76.87 GiB12mit
gemma-4-12B-it-qat-q4_0-unquantized12.0B6.50 GiB2apache-2.0
gemma-4-E4B-it8.0B3.30 GiB36apache-2.0
Qwen3-30B-A3B-Thinking-2507MoE30.5B7.05 GiB51apache-2.0
Qwen3-8B8.2B2.12 GiB51apache-2.0