Skip to content

Commit 2c7e300

Browse files
committed
safeguard against removing parameters not immediately on the module
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
1 parent 4b81ac7 commit 2c7e300

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/compressed_tensors/compressors/model_compressors/model_compressor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -479,7 +479,7 @@ def decompress_model(self, model: Module):
479479
# remove any existing parameters
480480
exec_device = get_execution_device(module)
481481
offload_device = get_offloaded_device(module)
482-
for name, _ in list(module.named_parameters()):
482+
for name, _ in list(module.named_parameters(recurse=False)):
483483
delete_offload_parameter(module, name)
484484

485485
# replace with decompressed parameters

0 commit comments

Comments
 (0)