pass current bnb_quantized when moving quantized Params4bit to different device (#1665)

mklabunde · web-flow · commit cd8bd2d61251 · 2025-06-03T16:41:07.000-04:00
diff --git a/bitsandbytes/nn/modules.py b/bitsandbytes/nn/modules.py
@@ -354,6 +354,7 @@ def to(self, *args, **kwargs):
                 compress_statistics=self.compress_statistics,
                 quant_type=self.quant_type,
                 quant_storage=self.quant_storage,
+                bnb_quantized=self.bnb_quantized,
             )
 
             return new_param

Original file line number	Diff line number	Diff line change
`@@ -354,6 +354,7 @@ def to(self, args, *kwargs):`
`354`	`354`	`compress_statistics=self.compress_statistics,`
`355`	`355`	`quant_type=self.quant_type,`
`356`	`356`	`quant_storage=self.quant_storage,`
	`357`	`+ bnb_quantized=self.bnb_quantized,`
`357`	`358`	`)`
`358`	`359`
`359`	`360`	`return new_param`