Ongoing research training transformer models at scale
GitHub repository
https://github.com/NVIDIA/Megatron-LMLicense
Other
Stars
18,318
This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.