1. Models
  2. Anthropic
  3. Software engineering SWE-bench Verified
AnthropicBlog · Aug 5, 2025 · official

Software engineering SWE-bench Verified

Software engineering benchmark accuracy comparison

BlogBar chartClaude 3.7 SonnetAll Anthropic modelsSonnet 3.7Opus 4Opus 4.1
Published by Anthropic on Blog, Aug 5, 2025. Source: anthropic.com

API

Not in the API yet

We have not read this chart's numbers yet, so the API has nothing to return for it. Charts with numbers read are on the data page, and each one can be called by id.

Charts with dataAPI docs

More charts about Claude 3.7 Sonnet

Claude 3.7 Sonnet: Claude 4 benchmarks
OfficialX · AnthropicMay 22, 2025
Claude 4 benchmarks4.3M views · 20.5K likes
Data
Claude 3.7 Sonnet: Computer Use Scores Over Time
OfficialX · AnthropicFeb 17, 2026
Computer Use Scores Over Time615.6K views · 2K likes
Data
Claude 3.7 Sonnet: Software engineering SWE-bench Verified
OfficialX · AnthropicMay 22, 2025
Software engineering SWE-bench Verified131.2K views · 860 likes
Data
Claude 3.7 Sonnet: Claude Sonnet OSWorld and OSWorld-Verified scores over time
OfficialBlog · AnthropicFeb 17, 2026
Claude Sonnet OSWorld and OSWorld-Verified scores over time
Claude 3.7 Sonnet: Mistral Wins vs Competitor Wins for Coding
Blog · mistral.aiMay 7, 2025
Mistral Wins vs Competitor Wins for Coding

More from Anthropic

Anthropic stacked bar chart: Firefox Security Vulnerabilities4.7x
Anthropic·Mar 2026
Firefox Security Vulnerabilities
3.2M views14.8K likes0.5% eng.
Data
Anthropic line chart: US GDP AI scenarios0.4x
Anthropic·Sep 2026
US GDP AI scenarios
856.3K views1.2K likes0.2% eng.
Data
Anthropic bar chart: RL reward hacking risks1.0x
Anthropic·Sep 2026
RL reward hacking risks
806.5K views3.2K likes0.5% eng.
Data
Claude Opus 4: Opus 4.8 benchmark comparison
OfficialX · AnthropicMay 28, 2026
Opus 4.8 benchmark comparison15.5M views · 66.3K likes
Data
Claude Mythos: Opus 4.7 Benchmark Comparison
OfficialX · AnthropicApr 16, 2026
Opus 4.7 Benchmark Comparison14.1M views · 79.6K likes
Data
Claude agents and computer use: AI Model Benchmark Comparison
OfficialX · AnthropicNov 24, 2025
AI Model Benchmark Comparison7.8M views · 18.8K likes
Data
Claude Fable 5: Claude Mythos 5 and Fable 5 Benchmark Comparison
OfficialX · AnthropicJun 9, 2026
Claude Mythos 5 and Fable 5 Benchmark Comparison6.3M views · 15.4K likes
Data
Claude Fable 5: AI Model Benchmark Comparison
OfficialX · AnthropicJul 24, 2026
AI Model Benchmark Comparison5.8M views · 10.7K likes
Data
Claude Opus 4.6: Long context MRCR v2 retrieval
OfficialX · AnthropicMar 13, 2026
Long context MRCR v2 retrieval5.7M views · 24.6K likes
Data

Questions people ask

Where does this chart come from?

Anthropic published it on Aug 5, 2025 on Blog (anthropic.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. The maker on any chart page redraws this type with your own numbers and words.