1. Models
  2. Anthropic
  3. Software engineering benchmark accuracy
AnthropicBlog · Sep 29, 2025 · official

Software engineering benchmark accuracy

AI model accuracy on SWE-bench Verified

BlogBar chartClaude Opus 4All Anthropic modelsGPT-5Gemini 2.5 ProSonnet 4.5Opus 4.1Sonnet 4GPT-5 Codex
Published by Anthropic on Blog, Sep 29, 2025. Source: anthropic.com

API

Not in the API yet

We have not read this chart's numbers yet, so the API has nothing to return for it. Charts with numbers read are on the data page, and each one can be called by id.

Charts with dataAPI docs

More charts about Claude Opus 4

Claude Opus 4: Opus 4.8 benchmark comparison
OfficialX · AnthropicMay 28, 2026
Opus 4.8 benchmark comparison15.5M views · 66.3K likes
Data
Claude Opus 4: Software Engineering Benchmark Comparison
OfficialX · AnthropicAug 5, 2025
Software Engineering Benchmark Comparison4.1M views · 10K likes
Data
Claude Opus 4: Novel problem-solving by cost
OfficialX · AnthropicJul 24, 2026
Novel problem-solving by cost3.7M views · 3.9K likes
Data
Claude Opus 4: Software engineering SWE-bench Verified
OfficialX · AnthropicNov 24, 2025
Software engineering SWE-bench Verified2M views · 1.3K likes
Data
Claude Opus 4: Sonnet 5 benchmark comparison
OfficialX · AnthropicJun 30, 2026
Sonnet 5 benchmark comparison1.5M views · 4.9K likes
Data
Claude Opus 4: SWE-bench Verified Accuracy
OfficialX · AnthropicSep 29, 2025
SWE-bench Verified Accuracy159.7K views · 1.1K likes
Data

More from Anthropic

Anthropic stacked bar chart: Firefox Security Vulnerabilities4.7x
Anthropic·Mar 2026
Firefox Security Vulnerabilities
3.2M views14.8K likes0.5% eng.
Data
Anthropic line chart: US GDP AI scenarios0.4x
Anthropic·Sep 2026
US GDP AI scenarios
856.3K views1.2K likes0.2% eng.
Data
Anthropic bar chart: RL reward hacking risks1.0x
Anthropic·Sep 2026
RL reward hacking risks
806.5K views3.2K likes0.5% eng.
Data
Claude Mythos: Opus 4.7 Benchmark Comparison
OfficialX · AnthropicApr 16, 2026
Opus 4.7 Benchmark Comparison14.1M views · 79.6K likes
Data
Claude agents and computer use: AI Model Benchmark Comparison
OfficialX · AnthropicNov 24, 2025
AI Model Benchmark Comparison7.8M views · 18.8K likes
Data
Claude Fable 5: Claude Mythos 5 and Fable 5 Benchmark Comparison
OfficialX · AnthropicJun 9, 2026
Claude Mythos 5 and Fable 5 Benchmark Comparison6.3M views · 15.4K likes
Data
Claude Fable 5: AI Model Benchmark Comparison
OfficialX · AnthropicJul 24, 2026
AI Model Benchmark Comparison5.8M views · 10.7K likes
Data
Claude Opus 4.6: Long context MRCR v2 retrieval
OfficialX · AnthropicMar 13, 2026
Long context MRCR v2 retrieval5.7M views · 24.6K likes
Data
Claude 3.7 Sonnet: Claude 4 benchmarks
OfficialX · AnthropicMay 22, 2025
Claude 4 benchmarks4.3M views · 20.5K likes
Data

Questions people ask

Where does this chart come from?

Anthropic published it on Sep 29, 2025 on Blog (anthropic.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. The maker on any chart page redraws this type with your own numbers and words.