speakleash · text

Bielik-11B-v3.0-Instruct

speakleash/Bielik-11B-v3.0-Instruct

Bielik-11B-v3.0-Instruct at Q4_K_M is exactly 6,724,051,584 bytes (6.26 GiB / 6.72 GB) — an effective 4.816 bits per weight, not the nominal 4.

From the file· summed from 1 file(s)
Parameters
11.2B
Architecture
Context
native (config.json)
License
apache-2.0

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
Q4_K_M6.26 GiB6,724,051,5844.816453speakleash
Q5_K_M7.36 GiB7,907,041,9205.664453speakleash
Q6_K8.53 GiB9,163,969,1526.564453speakleash
Q8_011.05 GiB11,868,811,9048.501453speakleash
BF1620.80 GiB22,339,170,68816.001speakleash
F1620.80 GiB22,339,170,94416.001453speakleash

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 5.85 GiB. The real file is 6.26 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

Architecture unavailable — this repository is gated and no ungated mirror was found. Exact file sizes above are still authoritative; only the KV math needs the config.

Questions people ask

How much VRAM does Bielik-11B-v3.0-Instruct need?
Q4_K_M is exactly 6,724,051,584 bytes (6.26 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
Which quantization of Bielik-11B-v3.0-Instruct should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.