NovaCorp · text

Imp-RPG.System-1B

NovaCorp/Imp-RPG.System-1B

Imp-RPG.System-1B at Q4_K_M is exactly 955,442,176 bytes (0.89 GiB / 0.96 GB) — an effective 5.101 bits per weight, not the nominal 4. Its KV cache at 32K is 1.00 GiB.

From the file· summed from 1 file(s)From the file· KV per layer
Parameters
1.5B
Architecture
llama
16 layers
Context
131,072
native (config.json)
License
llama3.2

Shipped quantizations

exact bytes, summed from published files
QuantSizeExact bytesEffective bpwTensorsPublisher
I1-IQ1_S0.45 GiB479,737,0882.561mradermacher
I1-IQ1_M0.47 GiB499,791,1042.668mradermacher
I1-IQ2_XXS0.50 GiB533,214,4642.847mradermacher
I1-IQ2_XS0.52 GiB562,050,3043.001mradermacher
I1-IQ2_S0.56 GiB601,572,6083.212mradermacher
I1-IQ2_M0.59 GiB628,311,2963.354mradermacher
I1-Q2_K_S0.60 GiB640,845,0563.421mradermacher
Q2_K0.62 GiB667,059,2003.561mradermacher
I1-Q2_K0.62 GiB667,059,4563.561mradermacher
I1-IQ3_XXS0.63 GiB674,972,9283.603mradermacher
I1-IQ3_XS0.68 GiB733,975,8083.918mradermacher
Q3_K_S0.70 GiB754,553,8564.028mradermacher
I1-Q3_K_S0.70 GiB754,554,1124.028mradermacher
I1-IQ3_S0.70 GiB756,782,3364.040mradermacher
I1-IQ3_M0.72 GiB770,151,6804.112mradermacher
Q3_K_M0.75 GiB803,705,8564.291mradermacher
I1-Q3_K_M0.75 GiB803,706,1124.291mradermacher
Q3_K_L0.79 GiB845,386,7524.513mradermacher
I1-Q3_K_L0.79 GiB845,387,0084.513mradermacher
I1-IQ4_XS0.82 GiB882,681,0884.712mradermacher
IQ4_XS0.83 GiB887,923,7124.740mradermacher
I1-IQ4_NL0.86 GiB920,773,8884.916mradermacher
I1-Q4_00.86 GiB920,773,8884.916mradermacher
Q4_K_S0.86 GiB923,395,0724.930mradermacher
I1-Q4_K_S0.86 GiB923,395,3284.930mradermacher
Q4_K_M0.89 GiB955,442,1765.101mradermacher
I1-Q4_K_M0.89 GiB955,442,4325.101mradermacher
I1-Q4_10.93 GiB995,910,9125.317mradermacher
Q5_K_S1.00 GiB1,073,144,8325.729mradermacher
I1-Q5_K_S1.00 GiB1,073,145,0885.729mradermacher
Q5_K_M1.02 GiB1,092,084,7365.830mradermacher
I1-Q5_K_M1.02 GiB1,092,084,9925.830mradermacher
Q6_K1.15 GiB1,237,267,4566.605mradermacher
I1-Q6_K1.15 GiB1,237,267,7126.605mradermacher
Q8_01.49 GiB1,600,164,8648.543mradermacher
F162.80 GiB3,004,929,02416.043mradermacher

KV cache by context

computed per layer
ContextKV cache (f16)Flat formulaOverstated byFull / windowed / recurrent
4,0960.13 GiB0.13 GiB16 / 0 / 0
8,1920.25 GiB0.25 GiB16 / 0 / 0
16,3840.50 GiB0.50 GiB16 / 0 / 0
32,7681.00 GiB1.00 GiB16 / 0 / 0
65,5362.00 GiB2.00 GiB16 / 0 / 0
131,0724.00 GiB4.00 GiB16 / 0 / 0

Compare with

same modality, comparable size

Will it run on your card?

full quant x context sweep

Why other calculators give a different number

A parameters × bits ÷ 8 estimate puts Q4_K_M at roughly 0.79 GiB. The real file is 0.89 GiB, because a quantization is a mixture and some tensors are always kept at higher precision.

Architecture

from config.json
Layers
16
Attention heads
32
KV heads
8
Head dim
64
Hidden size
2048
Vocab
128,256
Sliding window
none
SWA period
MLA
no
Experts
Experts per token
use_sliding_window

Questions people ask

How much VRAM does Imp-RPG.System-1B need?
Q4_K_M is exactly 955,442,176 bytes (0.89 GiB) in weights. Add the KV cache, which depends on your context length, plus roughly half a gigabyte of runtime overhead.
How large is Imp-RPG.System-1B's KV cache?
1.00 GiB at 32K context with an f16 cache, computed per layer. Quantizing the cache to q8_0 roughly halves it, which is often the difference between a context length fitting and not.
Which quantization of Imp-RPG.System-1B should I use?
Q4_K_M is the usual default. Pick the largest quantization that fits your card at the context you actually need — the table above gives exact sizes for every one published.