Skip to content

Commit

Permalink
Merge branch 'int8' of https://github.com/TimDettmers/bitsandbytes in…
Browse files Browse the repository at this point in the history
…to int8
  • Loading branch information
matthewdouglas committed Nov 4, 2024
2 parents 0aefeb0 + bfb42d1 commit 1ae2476
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions bitsandbytes/functional.py
Original file line number Diff line number Diff line change
Expand Up @@ -1439,11 +1439,9 @@ def dequantize_4bit(
else:
raise ValueError(f"Blockwise quantization only supports 16/32-bit floats, but got {A.dtype}")

is_transposed = A.shape[0] == 1
if is_transposed:
if A.shape[0] == 1: # is transposed, transpose back
return out.t()
else:
return out
return out


@deprecated("This function is deprecated and will be removed in a future release.", category=FutureWarning)
Expand Down

0 comments on commit 1ae2476

Please sign in to comment.