Skip to content

Commit 090baff

Browse files
ved1betakylesayrsdsikka
authored
error msg for using smoothquant without calibration dataset (#1526)
SUMMARY: check for calibration dataset not present #1510 --------- Co-authored-by: Kyle Sayers <kylesayrs@gmail.com> Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
1 parent 9e8210b commit 090baff

File tree

1 file changed

+8
-0
lines changed
  • src/llmcompressor/modifiers/smoothquant

1 file changed

+8
-0
lines changed

src/llmcompressor/modifiers/smoothquant/base.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -127,6 +127,14 @@ def on_initialize(self, state: State, **kwargs) -> bool:
127127
f"Expected start to be None or -1, got {self.end}"
128128
)
129129

130+
if (
131+
not hasattr(state, 'data') or
132+
state.data.calib is None
133+
):
134+
raise ValueError(
135+
f"{self.__class__.__name__} requires a calibration dataset to be "
136+
"provided"
137+
)
130138
self.ignore = [] if not self.ignore else self.ignore
131139
self.mappings = self._infer_mappings_from_model(state.model)
132140
self.resolved_mappings_ = self._resolve_mappings(state.model)

0 commit comments

Comments
 (0)