ONNX Runtime
Inference & Compute · Free + paid
Cross-platform ML model accelerator
At a glance
- Made by
- Microsoft
- Korean
- None (English and a few others only)
- API
- Yes
- Available on
- Windows, Mac, iOS, Android, Web, API
- Open source
- MIT
- GitHub
- 22,077 stars · MIT
What is ONNX Runtime?
ONNX Runtime is a cross-platform machine learning accelerator that speeds up training and inference on your existing technology stack. It supports models from PyTorch, TensorFlow/Keras, scikit-learn, LightGBM, XGBoost, and others, and optimizes latency, throughput, and memory on CPUs, GPUs, and NPUs. It runs with languages such as Python, C#, C++, Java, JavaScript, and Rust, and on Linux, Windows, Mac, iOS, Android, and web browsers. It is also used in Microsoft products such as Windows, Office, and Bing, and it supports on-device training and generative AI (onnxruntime-genai).
- Hardware-accelerated optimization for CPUs, GPUs, and NPUs
- Multi-language support including Python, C#, C++, Java, JavaScript, and Rust
- Runs in web browsers (ONNX Runtime Web)
- ONNX Runtime Mobile for Android and iOS apps
- On-device training
- Accelerating large-model training on multi-node NVIDIA GPUs
- Generative AI and LLM integration (onnxruntime-genai)
- Execution providers such as CUDA, TensorRT, OpenVINO, DirectML, and CoreML
Who uses ONNX Runtime and for what
- Adding AI features to mobile apps
- Running ML models in the browser
- Reducing training time for large transformer models
Pricing
Open source (free)
MIT 라이선스 오픈소스 추론·학습 가속 라이브러리(pip 설치), 요금 표기 없음
공식 페이지 확인 2026-10-14(산출 규칙 2026-10-15)
AI tools similar to ONNX Runtime (alternatives)
ONNX Runtime vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| ONNX Runtime | Free + paid | 0 | 6 | — | — | No |
| llama.cpp | Free + paid | 0 | 6 | — | — | — |
| SGLang | Free + paid | 0 | 6 | — | — | No |
| Sol Engine | Free + paid | 0 | 6 | — | — | No |
| TensorRT | Free + paid | 0 | 6 | No | — | Yes |
0 of these 5 tools have a free plan.
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
ONNX Runtime on AI Galaxy Map
- One of 43 AI tools in the Inference & Compute field.
- Connected to 6 other tools — #6 in its field.
Frequently asked questions
Can I use ONNX Runtime for free?
Open source (free). Prices can change, so check the official site before paying.
What AI can I use instead of ONNX Runtime?
Tools that do the same job, such as llama.cpp, SGLang, Sol Engine, TensorRT, are connected to it on the map.
Can I use ONNX Runtime in Korean?
None (English and a few others only)
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.