SWE-bench Multilingual
Benchmarks & Leaderboards · Free + paid
300 curated SWE-bench tasks from 42 repositories across 9 programming languages
At a glance
- Made by
- SWE-bench Team
- Korean
- None (English and a few others only)
- Available on
- Web
What is SWE-bench Multilingual?
SWE-bench is a collection of benchmarks that evaluate how well language models solve software problems using real GitHub issues. The Multilingual version consists of 300 tasks drawn from 42 repositories in 9 programming languages. The leaderboard shows the percentage of tasks each model resolved (% Resolved) and provides comparison charts by cost, steps, language, and repository.
- 9 languages, 42 repositories, 300 tasks
- % Resolved leaderboard
- Compare resolve results by language and by repository
- Analysis charts such as a scatter plot of resolve rate versus cost
- View open-weight models only
- Export results as JSON and PNG
Who uses SWE-bench Multilingual and for what
- Model and agent developers compare multilingual coding performance
Pricing
Free (public benchmark/leaderboard)
Mostly free leaderboards/datasets released for academic and community purposes
Estimate based on AI knowledge - please verify on the official site
AI tools similar to SWE-bench Multilingual (alternatives)
SWE-bench Multilingual vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| SWE-bench Multilingual | Free + paid | 0 | 5 | — | — | No |
| Aider Leaderboard | Free + paid | 0 | 12 | — | — | No |
| CORE-Bench Hard | Free + paid | 0 | 12 | — | — | No |
| Live-SWE-agent | Free + paid | 0 | 12 | — | — | No |
0 of these 4 tools have a free plan.
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
SWE-bench Multilingual on AI Galaxy Map
- One of 27 AI tools in the Benchmarks & Leaderboards field.
- Connected to 5 other tools — #11 in its field.
Frequently asked questions
Can I use SWE-bench Multilingual for free?
Free (public benchmark/leaderboard). Prices can change, so check the official site before paying.
What AI can I use instead of SWE-bench Multilingual?
Tools that do the same job, such as Aider Leaderboard, CORE-Bench Hard, Live-SWE-agent, BigCodeArena, are connected to it on the map.
Can I use SWE-bench Multilingual in Korean?
None (English and a few others only)
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.