Skip to content

fix(ppo): exclude no-eos rows from reward normalization - #1351

Open
haoyang9804 wants to merge 2 commits into
areal-project:mainfrom
haoyang9804:fix/reward-norm-no-eos-mask
Open

fix(ppo): exclude no-eos rows from reward normalization#1351
haoyang9804 wants to merge 2 commits into
areal-project:mainfrom
haoyang9804:fix/reward-norm-no-eos-mask

fix(ppo): use max seqlen for no-eos mask

cdc1c47
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Install test (Linux, CUDA extras, vllm)
succeeded May 19, 2026 in 2m 43s