Projects
MegatronAPP
Toolchain built around Megatron-LM for Distributed Training
MegatronApp is a toolchain built around the Megatron-LM training framework, designed to give practitioners a suite of value-added capabilities such as performance tuning, slow-node detection, and training-process visualization.