Skip to content

Commit 255c220

Browse files
ikawrakowKawrakow
andauthored
Add iq3_ks to constants.py (ikawrakow#606)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
1 parent e2b1a5e commit 255c220

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

gguf-py/gguf/constants.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1320,6 +1320,7 @@ class GGMLQuantizationType(IntEnum):
13201320
IQ2_KT = 153
13211321
IQ3_KT = 154
13221322
IQ4_KT = 155
1323+
IQ3_KS = 156
13231324
Q4_0_R8 = 202
13241325
Q5_0_R4 = 206
13251326
Q8_0_R8 = 208
@@ -1535,6 +1536,7 @@ def get_type(val: Any) -> GGUFValueType:
15351536
GGMLQuantizationType.IQ2_KT : ( 256, 68),
15361537
GGMLQuantizationType.IQ3_KT : ( 256, 100),
15371538
GGMLQuantizationType.IQ4_KT : ( 256, 128),
1539+
GGMLQuantizationType.IQ3_KS : ( 256, 102),
15381540
GGMLQuantizationType.Q4_0_R8 : ( 32, 18),
15391541
GGMLQuantizationType.Q5_0_R4 : ( 32, 22),
15401542
GGMLQuantizationType.Q8_0_R8 : ( 32, 34),

0 commit comments

Comments
 (0)