List view

fix no_shard training convergency and add unittest for no_shard

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

module: megatron-fsdp

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3754

#3754 In NVIDIA/Megatron-LM;

· wplf opened on Mar 9, 2026

Remove MoE throughput test

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2075

#2075 In NVIDIA/Megatron-LM;

· mathemakitten opened on Oct 31, 2025

nonuniform tensor parallelism

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2149

#2149 In NVIDIA/Megatron-LM;

· daiyaanarfeen opened on Nov 5, 2025

[MoE] Improvement of shared expert overlap, support shared expert overlap for FlexDispatcher

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2207

#2207 In NVIDIA/Megatron-LM;

· Victarry opened on Nov 11, 2025

feat: Apply RoPE embedding with sequence offsets

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2416

#2416 In NVIDIA/Megatron-LM;

· sudhakarsingh27 opened on Nov 26, 2025

[Dev] feat: Dynamic CP (part 2)

dev branchDev branch related issues and developmentDev branch related issues and development

enhancementNew feature or requestNew feature or request

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2000

#2000 In NVIDIA/Megatron-LM;

· xiaoyao0115 opened on Oct 28, 2025

added pad tokens as dummy sequence

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2591

#2591 In NVIDIA/Megatron-LM;

· jalbericiola opened on Dec 8, 2025

Dnarayanan/latent moe

community-request

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2594

#2594 In NVIDIA/Megatron-LM;

· pablo-garay opened on Dec 9, 2025

Track split_megabytes in wandb.

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2629

#2629 In NVIDIA/Megatron-LM;

· yobibyte opened on Dec 11, 2025

Fix kv cache offloading in MRL

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2633

#2633 In NVIDIA/Megatron-LM;

· sidsingh-nvidia opened on Dec 11, 2025

Log tokens per second

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2412

#2412 In NVIDIA/Megatron-LM;

· mathemakitten opened on Nov 26, 2025

Paged Stashing

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2690

#2690 In NVIDIA/Megatron-LM;

· nanz-nv opened on Dec 17, 2025

Explicitly delete objects in async checkpoint worker loop and call GC

complexity: low

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2740

#2740 In NVIDIA/Megatron-LM;

· apaithankar opened on Dec 23, 2025

Add flashinfer

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2768

#2768 In NVIDIA/Megatron-LM;

· kanz-nv opened on Dec 27, 2025

Update MoE functional test 2.0 configs

dev branchDev branch related issues and developmentDev branch related issues and development

Run functional tests

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2731

#2731 In NVIDIA/Megatron-LM;

· Victarry opened on Dec 22, 2025

Fix stale parameter index map in DistributedOptimizer

complexity: medium

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2872

#2872 In NVIDIA/Megatron-LM;

· ahmadki opened on Jan 8, 2026

fix --use-te-activation-func

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2908

#2908 In NVIDIA/Megatron-LM;

· ahmadki opened on Jan 12, 2026

Reorganize the building of active-masked tensors in context

complexity: medium

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2929

#2929 In NVIDIA/Megatron-LM;

· tdene opened on Jan 13, 2026

RL training cudagraphs test

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

Run functional tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2949

#2949 In NVIDIA/Megatron-LM;

· mathemakitten opened on Jan 14, 2026

[dev] feat(moe): Support packed sequence for gated delta net (GDN)

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2644

#2644 In NVIDIA/Megatron-LM;

· yuzhongw-nvidia opened on Dec 12, 2025

Change final review logic for PRs

complexity: medium

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3072

#3072 In NVIDIA/Megatron-LM;

· Phlip79 opened on Jan 25, 2026

Reset AG_pipeline bucket status after validation step.

complexity: low

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3155

#3155 In NVIDIA/Megatron-LM;

· vasunvidia opened on Jan 29, 2026

fix: Improve robustness and correctness in data preprocessing

community-request

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2628

#2628 In NVIDIA/Megatron-LM;

· iuyo5678 opened on Dec 11, 2025

Muon Documentation and user guide

docs-onlydocumentation only (docs or docstrings)documentation only (docs or docstrings)

Status: Open.

Documentation

#3176 In NVIDIA/Megatron-LM;

· BoxiangW opened on Jan 30, 2026

Fix averaging for MoE z-loss metric tracking

community-request

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3199

#3199 In NVIDIA/Megatron-LM;

· Marks101 opened on Feb 2, 2026