Model improvements: FSDP dtype + MoE dispatch + ACT deadlock fix + stochastic-depth (Option B)#56
Open
pzerfos wants to merge 4 commits into
Open
Model improvements: FSDP dtype + MoE dispatch + ACT deadlock fix + stochastic-depth (Option B)#56pzerfos wants to merge 4 commits into
pzerfos wants to merge 4 commits into
Commits
Commits on Apr 28, 2026
- committed
Petros Zerfos - andcommitted
- andcommitted
- andcommitted
