AI Rankings
DeepSWE Leaderboard: AI Models Ranked by Score
Data updated
What DeepSWE measures
Software engineering tasks scored as the share solved on the first try (pass@1), run with the open mini-SWE-agent setup.
Scores are percentages and higher is better. Results come from Epoch AI's open benchmark data; we do not run the test ourselves.
Top 20 at a glance
Full ranking
| Rank and model | DeepSWE score | Epoch index | Price per 1M tokens (in / out) | Released |
|---|---|---|---|---|
1GPT-6 AstraOpenAI | 74.1% | 168.8 | $10.00 / $50.00 | 2026-09-03 |
2Gemini 3.8 FlashGoogle | 73.8% | 157.4 | $0.75 / $3.75 | 2026-09-02 |
3Claude Opus 5Anthropic | 73.7% | 163.9 | $5.00 / $25.00 | 2026-07-24 |
4GPT-5.6 SolOpenAI | 72.7% | 162.8 | $4.00 / $20.00 | 2026-07-09 |
5Claude Fable 5Anthropic | 69.9% | 163.4 | $10.00 / $50.00 | 2026-06-09 |
6GPT-5.6 TerraOpenAI | 69.6% | 160.1 | $2.00 / $12.00 | 2026-07-09 |
7GLM-5.3Z.ai · Open weights | 69.0% | 156.0 | $1.40 / $4.40 | 2026-08-14 |
8Kimi K3Moonshot AI · Open weights | 68.5% | 157.9 | $3.00 / $15.00 | 2026-07-16 |
9Grok 4.6xAI | 67.5% | 156.6 | $2.00 / $6.00 | 2026-08-12 |
10GPT-5.6 LunaOpenAI | 67.2% | 156.5 | $0.20 / $1.20 | 2026-07-09 |
11GPT-5.5OpenAI | 67.0% | 159.7 | $5.00 / $30.00 | 2026-04-23 |
12Gemini 3.7 FlashGoogle | 65.5% | 158.0 | $0.75 / $3.75 | 2026-08-13 |
13GLM-5.3-FlashZ.ai · Open weights | 63.4% | 153.1 | $0.15 / $0.50 | 2026-08-20 |
14Claude Opus 4.8Anthropic | 59.0% | 159.0 | $5.00 / $25.00 | 2026-05-28 |
15Qwen 3.8 MaxAlibaba | 57.5% | 157.4 | $2.00 / $6.00 | 2026-08-02 |
16Muse Spark 1.2Meta | 54.9% | 155.1 | $1.25 / $4.25 | 2026-08-05 |
17Claude Sonnet 5Anthropic | 53.9% | 156.9 | $2.00 / $10.00 | 2026-06-30 |
18Grok 4.5xAI | 53.8% | 154.1 | $2.00 / $6.00 | 2026-07-08 |
19Muse Spark 1.1Meta | 53.3% | 154.1 | $1.25 / $4.25 | 2026-07-09 |
20GPT-5.4OpenAI | 51.8% | 157.3 | $2.50 / $15.00 | 2026-03-05 |
21Gemini 3.6 FlashGoogle | 46.7% | 154.5 | $0.75 / $3.75 | 2026-07-21 |
22GLM-5.2Z.ai · Open weights | 43.8% | 151.9 | $1.40 / $4.40 | 2026-06-16 |
23Gemini 3.5 FlashGoogle | 37.4% | 154.9 | $1.50 / $9.00 | 2026-05-19 |
24Kimi K2.7 CodeMoonshot AI · Open weights | 30.5% | 150.1 | $0.95 / $4.00 | 2026-06-12 |
25Claude Sonnet 4.6Anthropic | 29.9% | 152.8 | $3.00 / $15.00 | 2026-02-17 |
26Gemini 3.1 ProGoogle | 11.7% | 155.3 | $2.00 / $12.00 | 2026-02-19 |
How to read this leaderboard
Scores are percentages and higher is better. For each model we show the best result Epoch lists across its effort settings, the same rule for every model. A gap of a point or two is usually within the normal noise of a test, so treat close scores as a tie. Newer models can be missing when nobody has run the test on them yet, so check the release dates. A benchmark measures one kind of skill: use it together with the overall leaderboard rather than on its own.
Questions people ask
What does DeepSWE measure?
Software engineering tasks scored as the share solved on the first try (pass@1), run with the open mini-SWE-agent setup.
Who ran these tests?
The results come from Epoch AI's open benchmark data. It combines runs by Epoch with results published by other groups, and Epoch's own pages say which is which. We do not run tests ourselves.
Does a high score mean the model is best for me?
Not by itself. DeepSWE checks one kind of ability. A model can lead here and still be slower, costlier or a poor fit for your work. Compare it on the overall leaderboard and try it on your own tasks.
Why is a model I know missing?
A model appears only when an open source has published results for it. New models can take days or weeks to be measured, and models with no published score are left out rather than guessed.
Where does the data come from?
Scores come from Epoch AI's open benchmark data (licensed CC BY 4.0). We match models across sources, rank them and show them in charts, without changing the scores. Epoch AI does not endorse this site. Prices and context windows come from the open-source LiteLLM price list (MIT licence), which records each model maker's own price page. Prices change often, so confirm on the maker's site before you buy.
How often is this leaderboard updated?
We check our open data sources every day and show the date of the data at the top of the page. A model only moves when its source publishes new results, so a number can stay the same for weeks.
More leaderboards
- Overall intelligenceWhich AI model is the smartest overall?Leads: Claude Opus 5.5 (168.8)270 models ranked
- Human preferenceWhich AI do people prefer in blind tests?Leads: Gemini 4 Argon (1517)166 models ranked
- CodingWhich AI model is best for coding?Leads: Gemini 4 Argon (1552)166 models ranked
- Web developmentWhich AI model builds the best websites and apps?Leads: Claude Opus 5.5 (1807)85 models ranked
- Image understandingWhich AI model understands images best?Leads: Claude Fable 5 (1309)85 models ranked
- Open-weights modelsWhich open-source AI model is best?Leads: Kimi K3 (157.9)123 models ranked
- Cheapest strong modelsWhat is the cheapest AI model that is still good?Cheapest: gpt-oss-20b ($0.10)119 models ranked
- Best valueWhich AI models give the most intelligence for the money?Line starts at: gpt-oss-20b ($0.10)7 models ranked
- Context windowWhich AI model can read the most text at once?Leads: GPT-5.4 (1.1M tokens)193 models ranked
- GPQA DiamondWhich AI model scores highest on GPQA Diamond?Leads: Gemini 4 Argon (96.4%)183 models ranked
- Humanity's Last ExamWhich AI model scores highest on Humanity's Last Exam?Leads: GPT-6 Astra (54.8%)41 models ranked
- SWE-bench VerifiedWhich AI model scores highest on SWE-bench Verified?Leads: Claude Opus 4.7 (83.5%)32 models ranked
- Aider PolyglotWhich AI model scores highest on Aider Polyglot?Leads: GPT-5 (88.0%)46 models ranked
- Terminal-BenchWhich AI model scores highest on Terminal-Bench?Leads: GPT-5.3 Codex (64.7%)25 models ranked
- FrontierMath (Tiers 1-3)Which AI model scores highest on FrontierMath (Tiers 1-3)?Leads: GPT-6 Astra (93.7%)87 models ranked
- ARC-AGI-2Which AI model scores highest on ARC-AGI-2?Leads: GPT-6 Astra (95.0%)86 models ranked
- SimpleQA VerifiedWhich AI model scores highest on SimpleQA Verified?Leads: Gemini 4 Argon (76.0%)82 models ranked
- SimpleBenchWhich AI model scores highest on SimpleBench?Leads: Claude Fable 5 (81.9%)80 models ranked
Where this data comes from
- Epoch AI: Benchmark data: Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks (CC BY 4.0). We match models across sources, rank them and show them in charts. Scores are not changed. Epoch AI does not endorse this site.
- LiteLLM model price list: Prices and context windows: LiteLLM model price list (github.com/BerriAI/litellm, MIT licence). We use the model maker's own price entry when there is one. Prices change often, so always confirm on the maker's site before you buy.
Newest data on this page: 26 Oct 2026. Prices are list prices and change often, so confirm on the maker's site before you buy. Sponsors never change a score or an order. How we calculate this · Report a mistake