Skip to content

WIP: UL2 merge #23

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
RaymondLi0 wants to merge 144 commits into
base: multi-query-attention
Choose a base branch
from

fix pretrain_ul2 for causal-decoder

fe05ccd
Select commit
Loading
Failed to load commit list.
Open

WIP: UL2 merge #23

fix pretrain_ul2 for causal-decoder
fe05ccd
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs