1. Models
  2. Anthropic
  3. MMLU - Claude 3 comparison
A
@ArtificialAnlysX · Mar 4, 2024

MMLU - Claude 3 comparison

@ArtificialAnlys's bar chart drew 2.4K views on X: 0.2x @artificialanlys's median post and #1,057 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

MMLU benchmark comparison of Claude 3 models

XDataBar chartClaude 3All Anthropic modelsGPT-4Mistral LargeMistral MediumClaude 3 OpusClaude 2.0Claude 3 SonnetClaude 3 HaikuGemini Pro
Published by @ArtificialAnlys on X, Mar 4, 2024. Source: x.com
25/ 100

ViralChart score

Quiet

Fewer views and a lower engagement rate than the median post.

#1,003 of 1,162 AI chart posts we hold · #373 of 491 @artificialanlys posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

It sits in the Quiet quadrant, at #1,003 of 1,162 AI chart posts.

At 2.4K views, this post sits at 0.21x @ArtificialAnlys's median of 11.4K, ranked #420 of 491 @ArtificialAnlys posts.

Its 0.21% save rate lands in the 91st percentile among AI chart posts, against a 0.076% median.

The score of 25 puts it at #1,003 of 1,162 AI chart posts and #373 of 491 @ArtificialAnlys posts.

0.1xthe median bar chart post

Across 241 bar chart posts we hold, the median gets 25.6K views.

0.2x@artificialanlys's median post

2.4K views, where @artificialanlys's typical post gets 11.4K.

top 9%save rate

0.208% of viewers bookmarked it to come back to. The median post gets 0.076%.

2posts from @artificialanlys that day

Part of a run of 2 posts on Mar 4, 2024. This one was #2 of 2 by views that day.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 491 from @artificialanlys.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #1,003 of 1,162

Views2.4K#1,057bottom 9%
Likes11#1,105bottom 5%
Engagement rate0.66%#648bottom 44%
Save rate0.208%#103top 9%

Among 491 @artificialanlys posts

Score #373 of 491

Views2.4K#420bottom 15%
Likes11#447bottom 9%
Engagement rate0.66%#315bottom 36%
Save rate0.208%#52top 10%

Growth

One read so far

Views2.4K
Age at our read952 days
Views per day of life3views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@artificialanlys's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Mar 4, 2024

@ArtificialAnlys posts MMLU bar chart comparing Claude 3 models

A 10-model MMLU bar chart drew 2.4K views and a 0.21% save rate, the 91st percentile among AI chart posts.

What happened

@ArtificialAnlys posted a bar chart comparing Claude 3 models on MMLU on March 4, 2024. It was one of 2 posts from the account that day, alongside an MMLU vs. Price chart with 2.8K views.

The numbers

The post reached 2.4K views, ranked #1,057 of 1,162 AI chart posts and #420 of 491 @ArtificialAnlys posts. Its score of 25 ranked #1,003 of 1,162 AI chart posts.

The lesson

A 0.21% save rate, the 91st percentile among AI chart posts, shows readers kept this 10-model bar chart at more than the 0.076% median rate. The 2.4K views against a 39.9K median among AI chart posts show the saves came from a small pool.

What it means

At 0.21x @ArtificialAnlys's median views, this post reached a fraction of the account's typical audience while its 0.21% save rate beat the 0.076% median among AI chart posts. The gap between #420 of 491 @ArtificialAnlys posts by views and #103 of 1,162 AI chart posts by saves is the story.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

10 points read off this chart

Estimated from the image 97%
SeriesGroupValueRead
Claude 3 Opus0.87 scoreprinted
GPT-40.86 scoreprinted
Mistral Large0.81 scoreprinted
Claude 2.00.79 scoreprinted
Claude 3 Sonnet0.79 scoreprinted
Mistral Medium0.75 scoreprinted
Claude 3 Haiku0.75 scoreprinted
Gemini Pro0.72 scoreprinted
GPT-3.5 Turbo0.7 scoreprinted
Llama 2 Chat (70B)0.63 scoreprinted

Max plan · API

GET https://viral-chart.com/api/posts/80fefa703749.json
GET https://viral-chart.com/api/charts/80fefa703749.json
GET https://viral-chart.com/api/charts/80fefa703749.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 80fefa703749.

PathReturnsPlan
GET/api/v1/charts/80fefa703749Title, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/80fefa703749/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/80fefa703749/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/80fefa703749/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Claude 3

More from Anthropic

Questions people ask

Where does this chart come from?

@ArtificialAnlys published it on Mar 4, 2024 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.