File tree Expand file tree Collapse file tree 2 files changed +3
-2
lines changed
src/llmcompressor/modifiers/transform/spinquant Expand file tree Collapse file tree 2 files changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -28,8 +28,8 @@ class SpinquantRotation(str, Enum):
28
28
29
29
class SpinQuantModifier (Modifier , use_enum_values = True ):
30
30
"""
31
- Implements the transforms according to
32
- [SpinQuant: LLM quantization with learned rotations] (https://arxiv.org/abs/2405.16406) # noqa: E501
31
+ Implements the transforms according to "SpinQuant: LLM quantization
32
+ with learned rotations" (https://arxiv.org/abs/2405.16406)
33
33
34
34
Transforms (rotations) are extra layers added to a model which reduce the accuracy
35
35
loss induced by quantization. This is achived through "rotating" weights and
Original file line number Diff line number Diff line change @@ -18,6 +18,7 @@ class NormMapping(BaseModel):
18
18
:param linears: list of names or regexes of Linear layers that
19
19
receive input from norm.
20
20
"""
21
+
21
22
norm : str
22
23
linears : List [str ]
23
24
You can’t perform that action at this time.
0 commit comments