Support QAT with deepspeed zero3 and gradient checkpoint#290

Merged

yghstill merged 13 commits into

Tencent:mainfrom

yisunlp:deepspeed3

Apr 29, 2026

Commits on Apr 26, 2026

add deepspeed QAT

root
authored and
root
committed
fix bug for zero3 save and dataset labels

root
authored and
root
committed
feat(qat): add DeepSpeed ZeRO-3 support with MoE linearisation

root
authored and
root
committed

Commits on Apr 27, 2026

update document

root
authored and
root
committed
update document

root
authored and
root
committed
add zero3 qat for hunyuan v3

root
authored and
root
committed
fix pre-commit
root
committed

Commits on Apr 29, 2026

update

root
authored and
root
committed
update sft dataset configs

root
authored and
root
committed
fix pre-commit
root
committed
fix pre-commit
root
committed
fix pre-commit
root
committed
fix pre-commit
root
committed