Running on CPU Upgrade 806 The Ultimate MoE Training Handbook 🧩 806 A hands-on guide to training Mixture-of-Experts models
view article Article Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP +3 ariG23498, ror, sergiopaniego, pcuenq, sayakpaul • Jun 11 • 64
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 191
Nemotron Post-Training Datasets Collection Collection of datasets used in the post-training phase of Nemotron Nano, Super, Ultra v3, Super 3.5 VL, and Lightning 3.5. • 64 items • Updated 9 days ago • 209
Running 123 Unlocking On-Policy Distillation for Any Model Family 📝 123 Explore on‑policy distillation visualizations for any model
view article Article Continuous batching from first principles +1 ror, ArthurZ, mcpotato • Nov 25, 2025 • 467
view article Article Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries +7 aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego • Mar 10 • 201
Running 4.15k The Ultra-Scale Playbook 🌌 4.15k The ultimate guide to training LLM on large GPU Clusters