Skip to content

Commit 2977f82

Browse files
committed
fix merge
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 98734bf commit 2977f82

File tree

1 file changed

+2
-2
lines changed
  • src/compressed_tensors/transform/factory

1 file changed

+2
-2
lines changed

src/compressed_tensors/transform/factory/base.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -174,7 +174,7 @@ def output_hook(_, _input, output):
174174
def query_hook(_, query_states):
175175
return transform(query_states)
176176

177-
initialize_hooked_attention(model, module, quantize=False)
177+
initialize_hooked_attention(model, module)
178178
register_query_hook(module, query_hook)
179179

180180
# register key hook to kvcache
@@ -185,7 +185,7 @@ def query_hook(_, query_states):
185185
def key_hook(_, key_states):
186186
return transform(key_states)
187187

188-
initialize_hooked_kv_cache(model, module, quantize=False)
188+
initialize_hooked_kv_cache(model, module)
189189
register_key_hook(module, key_hook)
190190

191191
else:

0 commit comments

Comments
 (0)