Pinned Loading

1. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 14.3k 3.3k

2. NVIDIA/TransformerEngine NVIDIA/TransformerEngine Public

   A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance…

   Python 3k 559

3. Image-Generation-models Image-Generation-models Public

   Generative models (GAN, VAE, Diffusion Models, Autoregressive Models) implemented with Pytorch, Pytorch_lightning and hydra.

   Python 59 11

4. PP-Schedule-Visualization PP-Schedule-Visualization Public

   Pipeline Parallelism Emulation and Visualization

   Python 71 6

5. PyTorch-Memory-Profiler PyTorch-Memory-Profiler Public

   Python 34

6. Megatron-MoE-Echo Megatron-MoE-Echo Public

   Python 10