Skip to content

Commit

Permalink
Additional test fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
PinetreePantry committed Jan 29, 2025
1 parent 3f30793 commit 5294462
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion tests/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -134,11 +134,12 @@ def GPT2_SELF_ATTENTION_RUN(
)
CACHE_ACTIVATIONS[f"{i}.head_value_output"] = head_value

head_attention_value_output, attn_weights = eager_attention_forward(
head_attention_value_output = eager_attention_forward(
module=self_attn,
query=head_query,
key=head_key,
value=head_value,
attention_mask=None,
)


Expand Down

0 comments on commit 5294462

Please sign in to comment.