Pinned Loading

1. Megatron-Canzona Megatron-Canzona Public

   Forked from NVIDIA/Megatron-LM

   Bring Muon-style optimizers to Megatron-LM training.

   Python 13

2. zo2 zo2 Public

   ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

   Python 208 18

3. pytorch/torchtitan pytorch/torchtitan Public

   A PyTorch native platform for training generative AI models

   Python 5.8k 1k

4. Tiny-FSDP Tiny-FSDP Public

   Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP

   Python 111 9

5. Tiny-Megatron Tiny-Megatron Public

   Tiny-Megatron, a minimalistic re-implementation of the Megatron library

   Python 31 3

6. nGrove nGrove Public

   Independent exploration for new insights. Toward recursive self-improvement (RSI)

   Python 7