Megatron-LM
Inference & Compute · Free + paid
NVIDIA's large-scale transformer training
At a glance
- Made by
- NVIDIA
- Open source
- Apache
- GitHub
- 18,143 stars · NOASSERTION
What is Megatron-LM?
This repository consists of two parts: Megatron-LM and Megatron Core. Megatron-LM is a reference example that adds preconfigured training scripts to Megatron Core, suited to research teams, learning distributed training, and quick experiments. Megatron Core is a composable library providing transformer building blocks, advanced parallelism (TP, PP, DP, EP, CP), and mixed precision (FP16, BF16, FP8, FP4). Megatron Bridge converts checkpoints to and from Hugging Face in both directions, and it is installed from PyPI (megatron-core).
- Advanced parallelism strategies: TP, PP, DP, EP, CP
- FP16, BF16, FP8, FP4 mixed precision
- Preconfigured training scripts (Megatron-LM)
- Two-way Hugging Face ↔ Megatron checkpoint conversion (Megatron Bridge)
- Large-scale training optimization for MoE models
- Support for new optimizers such as Muon
- PyPI installation (megatron-core)
Who uses Megatron-LM and for what
- Distributed training experiments by research teams
- Building custom training pipelines for framework developers and ML engineers
Pricing
Open source (free)
Apache 라이선스 오픈소스 학습 라이브러리, PyPI·소스로 설치, 요금 표기 없음
공식 페이지 확인 2026-10-14(산출 규칙 2026-10-15)
AI tools similar to Megatron-LM (alternatives)
Megatron-LM vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| Megatron-LM | Free + paid | 0 | 4 | — | — | — |
| DeepSpeed | Free + paid | 0 | 4 | — | — | No |
| Horovod | Free + paid | 0 | 4 | — | — | No |
| Nanotron | Free | 0 | 4 | — | — | — |
0 of these 4 tools have a free plan.
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
Megatron-LM on AI Galaxy Map
- One of 43 AI tools in the Inference & Compute field.
- Connected to 4 other tools — #39 in its field.
Frequently asked questions
Can I use Megatron-LM for free?
Open source (free). Prices can change, so check the official site before paying.
What AI can I use instead of Megatron-LM?
Tools that do the same job, such as DeepSpeed, Horovod, Nanotron, FSDP, are connected to it on the map.
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.