DeepSpeed
Inference & Compute · Free + paid
Deep learning optimization library by Microsoft
At a glance
- Made by
- Microsoft (AI at Scale initiative)
- Korean
- None (English and a few others only)
- API
- Yes
- Open source
- Apache 2.0
- GitHub
- 43,229 stars · Apache-2.0
What is DeepSpeed?
DeepSpeed is a library that makes large-scale deep learning training effective and efficient through system innovations such as ZeRO, 3D parallelism, DeepSpeed-MoE, and ZeRO-Infinity. It states that it was used to train large language models such as MT-530B and BLOOM. It is integrated with popular open-source frameworks including Transformers, Accelerate, Lightning, and MosaicML, and is a core part of Microsoft's AI at Scale initiative. Beyond training, it also has inference-related tutorials (MoE inference, automatic tensor parallelism).
- ZeRO, ZeRO++, and ZeRO-Offload memory optimization
- Pipeline parallelism
- Automatic tensor parallelism (training and inference)
- DeepSpeed MoE (mixture of experts)
- Autotuning
- Flops profiler
- Long-sequence training with millions of tokens (ALST)
Who uses DeepSpeed and for what
- Training language models with billions to hundreds of billions of parameters
- Combining DeepSpeed with Hugging Face Transformers and Lightning training
Pricing
Open source (free)
Apache 2.0 오픈소스 학습 최적화 라이브러리(PyPI), 요금 표기 없음
공식 페이지 확인 2026-10-14(산출 규칙 2026-10-15)
AI tools similar to DeepSpeed (alternatives)
DeepSpeed vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| DeepSpeed | Free + paid | 0 | 4 | — | — | No |
| Horovod | Free + paid | 0 | 4 | — | — | No |
| Megatron-LM | Free + paid | 0 | 4 | — | — | — |
| Nanotron | Free | 0 | 4 | — | — | — |
0 of these 4 tools have a free plan.
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
DeepSpeed on AI Galaxy Map
- One of 43 AI tools in the Inference & Compute field.
- Connected to 4 other tools — #39 in its field.
Frequently asked questions
Can I use DeepSpeed for free?
Open source (free). Prices can change, so check the official site before paying.
What AI can I use instead of DeepSpeed?
Tools that do the same job, such as Horovod, Megatron-LM, Nanotron, FSDP, are connected to it on the map.
Can I use DeepSpeed in Korean?
None (English and a few others only)
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.