Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6667 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6667 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Copy Markdown
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
dimapihtar and others added 27 commits March 4, 2026 07:29
@dimapihtar @yaox12
[Cleanup] Remove the deprecated GroupedMLP (#3410)
2caa681 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@github-actions
chore: rotate oncall schedule
470c6ea
@tdene
Fix illegal memory access with mamba inference (#3631)
2a931a3
@tdene
Fix illegal memory access with mamba inference (bis) (#3696)
bb31e93
@YangWang92 @yaox12 @asolergi-nv
remove duplicate rerun_state_machine.set_mode(rerun_mode) (#3279)
4fa9b5a 
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
@jeromeku @asolergi-nv
Correct indexing when cp_comms_type is a list (#3389)
d3a8584 
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
@tdene
Fix optional chat_completions returnables (#3519)
bfd160b
@ko3n1g
ci: Claude code review (#3704)
f84e84e 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Fix event payload (#3705)
bd1406f 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Use issue number (#3706)
33476ff 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Finalize Claude review (#3707)
fd21af4 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@thomasdhc
ci: Add codecov yml (#3455)
b1b4df6 
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@tdene @sidsingh-nvidia
Robust signaling for coordinator inference (#3563)
7ea354b 
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
@WanZzzzzz @ko3n1g @kunlunl
Fix memory issue in mxfp8 model init (#3461)
f91c4bb 
Signed-off-by: qiyuw <qiyuw@nvidia.com>
Co-authored-by: qiyuw <qiyuw@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
c5d8f6b
@megnvidia
adding public_docs_features: True to get proper legal footer… (#3681)
fa6063d 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@mchrzanowski @claude @deepakn94
add --overlap-param-gather support for layer-wise optimizer. lots of …
a2381d8 
…unit tests. (#3524)

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Deepak Narayanan <dnarayanan@nvidia.com>
@ko3n1g
ci: Mount and enforce HF_HOME (#3700)
657d33b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@santhnm2
Add flags for changing Mamba inference state tensor dtype (#3660)
da47e64 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ko3n1g
chore: CLI launch internal CI (#3695)
94a903b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Change Review Process (#3659)
485428f
@ko3n1g
ci: Separate queues for internal/external contributors (#3718)
d1cce0c 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Update to correct token (#3724)
6bd5c12
@ko3n1g
build: Bump to NGC PyTorch 26.02 (#3474)
f5b2ec0 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Claude: use Opus 4.6 and auto-review on ready (#3727)
bb84493
@Phlip79
Claude to add complexity label (#3709)
41daf81
@santhnm2
Offload Flask frontend to separate process (#3648)
0d42bc6 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
wdykas and others added 30 commits April 1, 2026 18:58
@wdykas
Guard NVshmem issues (#4093)
f9a61e3 
Co-authored-by: root <root@nvl72063-T02.cm.cluster>
Co-authored-by: William Dykas <wdykas@oci-hsg-cs-001-vscode-03.cm.cluster>
@rapatel @cspades
m-fsdp: wire use_precision_aware_optimizer from ddp_config to ParamAn… (
fe5291f 
#4024)

Signed-off-by: Cory Ye <cye@nvidia.com>
Co-authored-by: Cory Ye <cye@nvidia.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@shjwudp @cspades
Megatron-FSDP: Add MXFP8 transpose helper buffer for Hybrid FSDP (#3918)
606ac26 
Signed-off-by: Cory Ye <cye@nvidia.com>
Co-authored-by: Cory Ye <cye@nvidia.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@Victarry @claude
@shjwudp @cspades
feat(fsdp): use TE general_gemm for mixed-precision wgrad in FSDP path (
8d7a3f8 
#3822)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Jianbin Chang <shjwudp@gmail.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@shjwudp @cspades
Megatron-FSDP: Make _pre_forward_param_unshard and _register_post_bac…
748ac49 
…kward_hook formal (#4029)

Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@shjwudp @cspades
Megatron-FSDP: Fix insufficient double buffers during gradient reduce (…
3dc2251 
…#4054)

Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@shjwudp @cspades
Fix M-FSDP MXFP8 related BUGs (#3991)
41f3b6f 
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@XueSongTap @cspades
FIX: Use decoupled gradients for precision-aware M-FSDP grad norm (#3746
a52ceeb 
)

Signed-off-by: yexiaochuan <yexiaochuan@baidu.com>
Co-authored-by: yexiaochuan <yexiaochuan@baidu.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@shjwudp @cspades
[Megatron-FSDP] Fix compatibility with frozen parameters and add unit…
150e37a 
… tests (#3287)

Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@santhnm2
Align chat completions endpoint with vLLM (#4063)
cb3bb41 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@shjwudp @cspades
[M-FSDP] Refactor uneven dtensor to full tensor and add UT (#3190)
159e347 
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@Phlip79 @claude
Add agent instruction files (#4102)
5a7f520 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@skyw
Bump eopt version (#4100)
17a67b9 
Signed-off-by: Hao Wu <skyw@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
8b8ceb5
@skyw
Refactor emerging optimizer integration (#4113)
5b512b4 
Signed-off-by: Hao Wu <skyw@nvidia.com>
@santhnm2
Fix over provisioning of Mamba state memory when max_requests is set (#…
dcc6d62 
…4114)

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@dimapihtar
base strategy simplification (#4001)
2697b82 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@dimapihtar
add support for DCP and FSDP async save (#4027)
69f3b34 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@skyw
Add more emerging optimizers (#3907) (#4119)
c9797ad 
Signed-off-by: Hao Wu <skyw@nvidia.com>
@DAISY-gh @cspades
Fix FSDP checkpoint conversion and loading for Qwen3.5-VL (#3936)
76e4daa 
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@Akshat8510
docs: update mcore optimizer docstrings to google style (#2799)
a025a69 
Signed-off-by: Akshat Kumar <akshat230405@gmail.com>
@Phlip79
Update oncall schedule (#4117)
07db9f7
@ilml @yaoyu-33
@claude @FDecaYed
Set tensor-parallel attributes irrespective of perform_initialization (…
a72c027 
…#4084)

Signed-off-by: Deyu Fu <deyuf@nvidia.com>
Co-authored-by: Tom Long <tolong@oci-hsg-cs-001-vscode-02.cm.cluster>
Co-authored-by: yaoyu-33 <yaoyu.094@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Deyu Fu <deyuf@nvidia.com>
@ko3n1g @claude
docs: add developer-guide skill with CI/CD and failure navigation gui…
c0e3134 
…dance (#4035)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g
chore: Move skills (#4136)
8758d16 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Let Claude react to comment (#4135)
fd76254 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@maanug-nv
Nemotron3 Super GB200 release config (#4118)
d865bba 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@vasunvidia @asolergi-nv
@Phlip79 @claude
Enable CUDA graph for ADAM optimizer (#3429)
3d87bfc 
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@Phlip79
Claude review should recommend testing (#4137)
499266a
@Phlip79 @claude
cleanup: remove unused scatter_gather_tensors_in_pipeline argument (#…
10e7b74 
…4140)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.