Skip to content

Commit

Permalink
QuantState.to(): move code tensor with others to correct device, fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
matthewdouglas committed Feb 19, 2025
1 parent 8ed7d97 commit 9784fe6
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions bitsandbytes/functional.py
Original file line number Diff line number Diff line change
Expand Up @@ -821,6 +821,7 @@ def as_dict(self, packed=False):

def to(self, device):
# make sure the quantization state is on the right device
self.code = self.code.to(device)
self.absmax = self.absmax.to(device)
if self.nested:
self.offset = self.offset.to(device)
Expand Down

0 comments on commit 9784fe6

Please sign in to comment.