DavidAU · vision language

Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP

DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP

Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP at Q4_K_M is exactly 36,545,830,912 bytes (34.04 GiB / 36.55 GB) — an effective 10.524 bits per weight, not the nominal 4. Its KV cache at 32K is 2.00 GiB.

From the file· summed from 2 file(s)From the file· KV per layer
Parameters
27.8B
Architecture
qwen35
64 layers
Context
262,144
native (config.json)
License
apache-2.0

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-Q2_K10.12 GiB10,864,593,2163.129mradermacher
I1-Q3_K_S11.41 GiB12,256,536,8963.529mradermacher
I1-IQ3_S11.74 GiB12,602,607,9363.629mradermacher
I1-IQ3_M11.89 GiB12,768,332,0963.677mradermacher
I1-Q3_K_M12.57 GiB13,500,737,8563.888mradermacher
I1-Q3_K_L13.56 GiB14,559,799,6164.193mradermacher
I1-IQ4_XS14.26 GiB15,309,039,9364.408mradermacher
I1-Q4_014.68 GiB15,760,419,1364.538mradermacher
I1-Q4_K_S14.74 GiB15,825,299,7764.557mradermacher
I1-Q4_K_M15.66 GiB16,810,715,4564.841mradermacher
I1-Q4_116.15 GiB17,343,768,8964.994mradermacher
I1-Q5_K_S17.67 GiB18,971,683,1365.463mradermacher
I1-Q5_K_M18.19 GiB19,535,702,3365.625mradermacher
I1-Q6_K20.89 GiB22,431,000,8966.459mradermacher
IQ2_M2 shards22.16 GiB23,797,932,0326.853DavidAU
IQ2_M2 shards22.16 GiB23,797,932,0326.853connorhzp
IQ3_M2 shards26.65 GiB28,612,780,0328.239DavidAU
IQ3_M2 shards26.65 GiB28,612,780,0328.239connorhzp
Q4_K_S2 shards32.25 GiB34,623,660,0329.970connorhzp
Q4_K_S2 shards32.25 GiB34,623,660,0329.970DavidAU
IQ4_NL2 shards32.65 GiB35,054,886,91210.095connorhzp
IQ4_NL2 shards32.65 GiB35,054,886,91210.095DavidAU
Q4_K_M2 shards34.04 GiB36,545,830,91210.524connorhzp
Q4_K_M2 shards34.04 GiB36,545,830,91210.524DavidAU
Q5_K_S2 shards38.01 GiB40,810,258,43211.752connorhzp
Q5_K_S2 shards38.01 GiB40,810,258,43211.752DavidAU
Q5_K_M2 shards39.03 GiB41,913,229,31212.069DavidAU
Q5_K_M2 shards39.03 GiB41,913,229,31212.069connorhzp
Q8_02 shards55.90 GiB60,026,724,35217.285DavidAU
Q8_02 shards55.90 GiB60,026,724,35217.285connorhzp
IQ4_XS4 shards61.06 GiB65,563,483,07218.880connorhzp
IQ4_XS4 shards61.06 GiB65,563,483,07218.880DavidAU
Q6_K4 shards88.00 GiB94,491,564,99227.210connorhzp
Q6_K4 shards88.00 GiB94,491,564,99227.210DavidAU

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.25 GiB1.00 GiB4.00×16 / 0 / 48
8,1920.50 GiB2.00 GiB4.00×16 / 0 / 48
16,3841.00 GiB4.00 GiB4.00×16 / 0 / 48
32,7682.00 GiB8.00 GiB4.00×16 / 0 / 48
65,5364.00 GiB16.00 GiB4.00×16 / 0 / 48
131,0728.00 GiB32.00 GiB4.00×16 / 0 / 48

48 of 64 layers use linear attention, which keeps a fixed-size recurrent state instead of a per-token cache. Those layers do not grow with context at all — treating them as ordinary attention, as a flat formula does, overstates this model's cache by roughly 4.0× at long context.

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 14.55 GiB. The real file is 34.04 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
64
Attention heads
24
KV heads
4
Head dim
256
Hidden size
5120
Vocab
248,320
Sliding window
none
SWA period
MLA
no
Experts
Experts per token
use_sliding_window

Questions people ask

How much VRAM does Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP need?
Q4_K_M is exactly 36,545,830,912 bytes (34.04 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP's KV cache?
2.00 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Which quantization of Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.