We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 783a081 commit 735660dCopy full SHA for 735660d
src/compressed_tensors/compressors/quantized_compressors/base.py
@@ -102,7 +102,7 @@ def compress(
102
model_state[name] = value.to(save_device)
103
continue
104
105
- # compress values on cpu. TODO: experiment with different devices
+ # compress values on cpu (memory movement too expensive)
106
quant_args = names_to_scheme[prefix].weights
107
compressed_values = self.compress_weight(
108
weight=value,
0 commit comments