1. Models
  2. Anthropic
  3. AI performance on SWE-bench Verified over time
E
@EpochAIResearchX · May 14, 2025

AI performance on SWE-bench Verified over time

@EpochAIResearch's scatter plot drew 647 views on X: 0.1x @epochairesearch's median post and #1,146 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

AI performance solving issues from 12 open-source Python repositories

Published by @EpochAIResearch on X, May 14, 2025. Source: x.com
17/ 100

ViralChart score

Small but loved

Fewer views than the median post but a higher engagement rate: a smaller crowd that acted on it.

#1,095 of 1,162 AI chart posts we hold · #56 of 59 @epochairesearch posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

The post sits in the Small but loved quadrant, at #1,095 of 1,162 AI chart posts.

At 647 views, the post sits at 0.12x @EpochAIResearch's median of 5.3K views.

Its 0.000% save rate lands in the bottom decile, 2nd percentile among AI chart posts.

A score of 17 puts it at #1,095 of 1,162 AI chart posts.

0.0xthe median scatter plot post

Across 187 scatter plot posts we hold, the median gets 22.4K views.

0.1x@epochairesearch's median post

647 views, where @epochairesearch's typical post gets 5.3K.

bottom 2%save rate

0.000% of viewers bookmarked it to come back to. The median post gets 0.076%.

top 3%engagement rate

1.85% of viewers liked, reposted, quoted or replied. The median post gets 0.73%.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 59 from @epochairesearch.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #1,095 of 1,162

Views647#1,146bottom 1%
Likes11#1,110bottom 5%
Engagement rate1.85%#35top 3%
Save rate0.000%#1,153bottom 2%

Among 59 @epochairesearch posts

Score #56 of 59

Views647#55bottom 8%
Likes11#56bottom 6%
Engagement rate1.85%#17top 28%
Save rate0.000%#56bottom 3%

Growth

One read so far

Views647
Age at our read516 days
Views per day of life1views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@epochairesearch's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · May 14, 2025

@EpochAIResearch charts SWE-bench Verified accuracy over time

A scatter plot of AI performance on SWE-bench Verified drew 647 views and a 1.85% engagement rate.

What happened

@EpochAIResearch posted a scatter plot on May 14, 2025, charting AI performance on SWE-bench Verified over time. It was the account's only post that day.

The numbers

It reached 647 views, ranking #1,146 of 1,162 AI chart posts. Its score of 17 ranked #1,095 of 1,162 AI chart posts and #56 of 59 @EpochAIResearch posts.

The lesson

A 0.000% save rate at the 2nd percentile among AI chart posts shows a scatter plot of 6 models that readers did not bookmark. The 1.85% engagement rate sits above the median while saves sit in the bottom decile.

What it means

At #56 of 59 @EpochAIResearch posts, this chart trails the account's own output. The 0.12x gap to its 5.3K company median views marks it as a low-reach post for this publisher.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

22 points read off this chart

Estimated from the image 39%
SeriesGroupValueRead
AnthropicClaude 3.7 Sonnet55 %estimated
OpenAIo3-mini (medium)38 %printed
OpenAIo4-mini (medium)35 %estimated
OpenAIGPT-4.133 %estimated
OtherGrok-332 %estimated
AnthropicClaude 3.530 %estimated
OpenAIo3-mini (medium)30 %estimated
OpenAIo4-mini (medium)28 %estimated
OpenAIo3-mini (medium)25 %estimated
OpenAIo4-mini (medium)22 %estimated
OpenAIo4-mini (medium)18 %estimated
OpenAIo4-mini (medium)15 %estimated

Showing 12 of 22. All points, the redraw and the maker

Max plan · API

GET https://viral-chart.com/api/posts/f34408617b62.json
GET https://viral-chart.com/api/charts/f34408617b62.json
GET https://viral-chart.com/api/charts/f34408617b62.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id f34408617b62.

Approximate values. Our two readings of this chart agreed only in part (confidence 0.39 of 1), so check the original before you quote a number. The API marks it lowConfidence, and ?min_confidence=0.5 leaves it out.

PathReturnsPlan
GET/api/v1/charts/f34408617b62Title, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/f34408617b62/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/f34408617b62/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/f34408617b62/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Claude 3

More from Anthropic

Questions people ask

Where does this chart come from?

@EpochAIResearch published it on May 14, 2025 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.