AI Rankings
SWE-bench Verified Leaderboard: AI Models Ranked by Score
Data updated
What SWE-bench Verified measures
Real bug reports from open-source software projects. The AI has to change the code so the project's own tests pass. The tasks were checked by people.
Scores are percentages and higher is better. Results come from Epoch AI's open benchmark data; we do not run the test ourselves.
Top 20 at a glance
Full ranking
| Rank and model | SWE-bench Verified score | Epoch index | Price per 1M tokens (in / out) | Released |
|---|---|---|---|---|
1Claude Opus 4.7Anthropic | 83.5% | 156.8 | $5.00 / $25.00 | 2026-04-16 |
2GPT-5.5OpenAI | 80.6% | 159.7 | $5.00 / $30.00 | 2026-04-23 |
3Gemini 3.5 FlashGoogle | 79.3% | 154.9 | $1.50 / $9.00 | 2026-05-19 |
4Claude Opus 4.6Anthropic | 78.7% | 155.7 | $5.00 / $25.00 | 2026-02-05 |
5GLM-5.2Z.ai · Open weights | 78.7% | 151.9 | $1.40 / $4.40 | 2026-06-16 |
6DeepSeek-V4-ProDeepSeek · Open weights | 77.6% | 149.1 | $1.32 / $3.96 | 2026-04-24 |
7Qwen3.7-MaxAlibaba | 77.3% | 154.0 | $2.50 / $7.50 | 2026-05-19 |
8GPT-5.4OpenAI | 76.9% | 157.3 | $2.50 / $15.00 | 2026-03-05 |
9Claude Opus 4.5Anthropic | 76.7% | 150.1 | $5.00 / $25.00 | 2025-11-24 |
9Kimi K2.6Moonshot AI · Open weights | 76.7% | 150.9 | $0.95 / $4.00 | 2026-04-20 |
9Qwen 3.6 Max (Preview)Alibaba | 76.7% | 149.4 | $1.27 / $7.61 | 2026-04-20 |
12Gemini 3.1 ProGoogle | 75.6% | 155.3 | $2.00 / $12.00 | 2026-02-19 |
13Gemini 3 FlashGoogle | 75.4% | 151.9 | $0.50 / $3.00 | 2025-12-17 |
14Claude Sonnet 4.6Anthropic | 75.2% | 152.8 | $3.00 / $15.00 | 2026-02-17 |
15GPT-5.3 CodexOpenAI | 74.8% | 157.1 | $1.75 / $14.00 | 2026-02-05 |
16GLM-5.1Z.ai · Open weights | 74.2% | 149.8 | $1.40 / $4.40 | 2026-04-07 |
17GPT-5.2OpenAI | 73.8% | 153.7 | $1.75 / $14.00 | 2025-12-11 |
17Kimi K2.5Moonshot AI · Open weights | 73.8% | 148.1 | $0.60 / $3.00 | 2026-01-27 |
19GPT-5OpenAI | 73.5% | 150.0 | $1.25 / $10.00 | 2025-08-07 |
20Claude Opus 4.1Anthropic | 73.3% | 144.1 | $15.00 / $75.00 | 2025-08-05 |
21Gemini 3 ProGoogle | 72.9% | 153.1 | $2.00 / $12.00 | 2025-11-18 |
22GLM-5Z.ai · Open weights | 72.1% | 145.8 | $1.00 / $3.20 | 2026-02-11 |
23Claude Sonnet 4.5Anthropic | 71.3% | 146.7 | $3.00 / $15.00 | 2025-09-29 |
24Claude Opus 4Anthropic | 70.7% | 142.5 | $15.00 / $75.00 | 2025-05-22 |
25GPT-5.1OpenAI | 68.0% | 149.8 | $1.25 / $10.00 | 2025-11-13 |
26GPT-5 miniOpenAI | 64.7% | 145.3 | $0.25 / $2.00 | 2025-08-07 |
27o3OpenAI | 62.3% | 146.7 | $2.00 / $8.00 | 2025-04-16 |
28Claude 3.7 SonnetAnthropic | 61.0% | 141.0 | $3.00 / $15.00 | 2025-02-24 |
29Qwen 3.6 PlusAlibaba | 57.9% | 147.3 | $0.50 / $3.00 | 2026-03-31 |
30Gemini 2.5 Pro (Jun 2025)Google | 57.6% | 145.1 | $1.25 / $10.00 | 2025-06-05 |
31GPT-4.1OpenAI | 48.5% | 136.7 | $2.00 / $8.00 | 2025-04-14 |
32GPT-4o (Nov 2024)OpenAI | 31.0% | 128.7 | $2.50 / $10.00 | 2024-11-20 |
How to read this leaderboard
Scores are percentages and higher is better. For each model we show the best result Epoch lists across its effort settings, the same rule for every model. A gap of a point or two is usually within the normal noise of a test, so treat close scores as a tie. Newer models can be missing when nobody has run the test on them yet, so check the release dates. A benchmark measures one kind of skill: use it together with the overall leaderboard rather than on its own.
Questions people ask
What does SWE-bench Verified measure?
Real bug reports from open-source software projects. The AI has to change the code so the project's own tests pass. The tasks were checked by people.
Who ran these tests?
The results come from Epoch AI's open benchmark data. It combines runs by Epoch with results published by other groups, and Epoch's own pages say which is which. We do not run tests ourselves.
Does a high score mean the model is best for me?
Not by itself. SWE-bench Verified checks one kind of ability. A model can lead here and still be slower, costlier or a poor fit for your work. Compare it on the overall leaderboard and try it on your own tasks.
Why is a model I know missing?
A model appears only when an open source has published results for it. New models can take days or weeks to be measured, and models with no published score are left out rather than guessed.
Where does the data come from?
Scores come from Epoch AI's open benchmark data (licensed CC BY 4.0). We match models across sources, rank them and show them in charts, without changing the scores. Epoch AI does not endorse this site. Prices and context windows come from the open-source LiteLLM price list (MIT licence), which records each model maker's own price page. Prices change often, so confirm on the maker's site before you buy.
How often is this leaderboard updated?
We check our open data sources every day and show the date of the data at the top of the page. A model only moves when its source publishes new results, so a number can stay the same for weeks.
More leaderboards
- Overall intelligenceWhich AI model is the smartest overall?Leads: Claude Opus 5.5 (168.8)270 models ranked
- Human preferenceWhich AI do people prefer in blind tests?Leads: Gemini 4 Argon (1517)166 models ranked
- CodingWhich AI model is best for coding?Leads: Gemini 4 Argon (1552)166 models ranked
- Web developmentWhich AI model builds the best websites and apps?Leads: Claude Opus 5.5 (1807)85 models ranked
- Image understandingWhich AI model understands images best?Leads: Claude Fable 5 (1309)85 models ranked
- Open-weights modelsWhich open-source AI model is best?Leads: Kimi K3 (157.9)123 models ranked
- Cheapest strong modelsWhat is the cheapest AI model that is still good?Cheapest: gpt-oss-20b ($0.10)119 models ranked
- Best valueWhich AI models give the most intelligence for the money?Line starts at: gpt-oss-20b ($0.10)7 models ranked
- Context windowWhich AI model can read the most text at once?Leads: GPT-5.4 (1.1M tokens)193 models ranked
- GPQA DiamondWhich AI model scores highest on GPQA Diamond?Leads: Gemini 4 Argon (96.4%)183 models ranked
- Humanity's Last ExamWhich AI model scores highest on Humanity's Last Exam?Leads: GPT-6 Astra (54.8%)41 models ranked
- Aider PolyglotWhich AI model scores highest on Aider Polyglot?Leads: GPT-5 (88.0%)46 models ranked
- Terminal-BenchWhich AI model scores highest on Terminal-Bench?Leads: GPT-5.3 Codex (64.7%)25 models ranked
- FrontierMath (Tiers 1-3)Which AI model scores highest on FrontierMath (Tiers 1-3)?Leads: GPT-6 Astra (93.7%)87 models ranked
- ARC-AGI-2Which AI model scores highest on ARC-AGI-2?Leads: GPT-6 Astra (95.0%)86 models ranked
- SimpleQA VerifiedWhich AI model scores highest on SimpleQA Verified?Leads: Gemini 4 Argon (76.0%)82 models ranked
- SimpleBenchWhich AI model scores highest on SimpleBench?Leads: Claude Fable 5 (81.9%)80 models ranked
- DeepSWEWhich AI model scores highest on DeepSWE?Leads: GPT-6 Astra (74.1%)26 models ranked
Where this data comes from
- Epoch AI: Benchmark data: Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks (CC BY 4.0). We match models across sources, rank them and show them in charts. Scores are not changed. Epoch AI does not endorse this site.
- LiteLLM model price list: Prices and context windows: LiteLLM model price list (github.com/BerriAI/litellm, MIT licence). We use the model maker's own price entry when there is one. Prices change often, so always confirm on the maker's site before you buy.
Newest data on this page: 26 Oct 2026. Prices are list prices and change often, so confirm on the maker's site before you buy. Sponsors never change a score or an order. How we calculate this · Report a mistake