EXO
Inference & Compute · Free
Run frontier AI on your own devices by clustering everyday hardware
At a glance
- Made by
- Exo Labs
- Korean
- None (English and a few others only)
- API
- Yes
- Available on
- Mac, API
- Open source
- Apache-2.0
- GitHub
- 47,870 stars · Apache-2.0
What is EXO?
Exo is open-source software that connects multiple devices into a single local AI cluster, and Exo Labs is the company that makes it. When you connect devices with Thunderbolt or USB-C, it splits a model across them and automatically optimizes the run settings. You can access it through APIs in OpenAI Chat Completions, Responses, Claude Messages, and Ollama formats. It runs on Apple silicon Macs, Linux can be installed from source, and once models are downloaded it can be used offline.
- Automatic device discovery
- RDMA over Thunderbolt 5 (99% lower latency between devices)
- Topology-aware automatic parallelization
- Tensor parallelism (up to 1.8x speed with 2 devices, up to 3.2x with 4)
- MLX inference backend
- OpenAI, Claude Messages, and Ollama compatible APIs
- Load custom Hugging Face models
- Cluster management and chat dashboard
Who uses EXO and for what
- Individuals and teams run large models locally on devices they own, such as Mac Studio
- Connect local models to coding agents like Claude Code and OpenAI Codex
- Companies run local AI on their own infrastructure (Exo for Business)
Pricing
Open source (free)
Apache-2.0 오픈소스 소프트웨어로, 사용자가 가진 기기에서 로컬 추론
공식 페이지 확인 2026-10-14(산출 규칙 2026-10-15)
AI tools similar to EXO (alternatives)
EXO vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| EXO | Free | 0 | 6 | — | — | No |
| FastChat | Free + paid | 0 | 6 | — | — | — |
| LM Studio | Free + paid | 0 | 6 | Yes | $20/mo | No |
| ollama | Free + paid | 0 | 6 | Yes | $20/mo | — |
| Open WebUI | Free + paid | 0 | 5 | — | — | No |
2 of these 5 tools have a free plan. Cheapest paid plan: LM Studio ($20/mo).
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
EXO on AI Galaxy Map
- One of 43 AI tools in the Inference & Compute field.
- Connected to 6 other tools — #6 in its field.
Frequently asked questions
Can I use EXO for free?
Open source (free). Prices can change, so check the official site before paying.
What AI can I use instead of EXO?
Tools that do the same job, such as FastChat, LM Studio, ollama, Open WebUI, are connected to it on the map.
Can I use EXO in Korean?
None (English and a few others only)
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.