1. Models
  2. Anthropic
  3. MMLU vs. Price
A
@ArtificialAnlysX · Mar 4, 2024

MMLU vs. Price

@ArtificialAnlys's scatter plot drew 2.8K views on X: 0.2x @artificialanlys's median post and #1,047 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

Most attractive quadrant for MMLU quality vs price

Published by @ArtificialAnlys on X, Mar 4, 2024. Source: x.com
32/ 100

ViralChart score

Small but loved

Fewer views than the median post but a higher engagement rate: a smaller crowd that acted on it.

#879 of 1,162 AI chart posts we hold · #286 of 491 @artificialanlys posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

The post sits in the Small but loved quadrant, with a score rank of #879 of 1,162 AI chart posts.

Its 0.68% save rate is 9x the AI chart median of 0.076%, at the 99th percentile.

Views of 2.8K are 0.24x this account's median of 11.4K, ranking #413 of 491 @ArtificialAnlys posts.

The post carries 3 charts, and every chart in the post shares the post's numbers.

top 1%save rate

0.685% of viewers bookmarked it to come back to. The median post gets 0.076%.

0.1xthe median scatter plot post

Across 187 scatter plot posts we hold, the median gets 22.4K views.

3charts in this one post

The numbers belong to the post, so every chart in it shares them and it is ranked once.

0.2x@artificialanlys's median post

2.8K views, where @artificialanlys's typical post gets 11.4K.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 491 from @artificialanlys.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #879 of 1,162

Views2.8K#1,047bottom 10%
Likes20#1,022bottom 12%
Engagement rate0.86%#426top 37%
Save rate0.685%#1top 1%

Among 491 @artificialanlys posts

Score #286 of 491

Views2.8K#413bottom 16%
Likes20#386bottom 22%
Engagement rate0.86%#213top 43%
Save rate0.685%#1top 1%

Growth

One read so far

Views2.8K
Age at our read952 days
Views per day of life3views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@artificialanlys's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Mar 4, 2024

@ArtificialAnlys plots MMLU against price in a scatter

A 10-model scatter on MMLU versus price drew 2.8K views and a 0.68% save rate, 9x the AI chart median.

What happened

@ArtificialAnlys posted a scatter plot on MMLU versus price on March 4, 2024. It came with 3 charts in the post and 2 posts from this account that day, including MMLU - Claude 3 comparison at 2.4K views.

The numbers

The post reached 2.8K views, ranking #1,047 of 1,162 AI chart posts. Its score of 32 ranks #879 of 1,162 AI chart posts and #286 of 491 @ArtificialAnlys posts.

The lesson

A 0.68% save rate, 9x the AI chart median, shows readers keep this scatter for its 10-model comparison. The 3 charts in the post share the post's numbers, so the saves attach to the whole post.

What it means

At #286 of 491 @ArtificialAnlys posts by score, this post trails the account's own output despite a #1 of 1,162 rank by saves. The 2.8K views against the 39.9K AI chart median leave the reach gap wide.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

10 points read off this chart

Estimated from the image 35%
SeriesGroupValueRead
Claude 3 Haiku0.75 USD per 1M Tokensestimated
Gemini Pro0.73 USD per 1M Tokensestimated
Llama 2 Chat (70B)0.63 USD per 1M Tokensestimated
Mistral Small0.72 USD per 1M Tokensestimated
Claude 3 Sonnet0.73 USD per 1M Tokensestimated
Mistral Medium0.75 USD per 1M Tokensestimated
Mistral Large0.81 USD per 1M Tokensestimated
GPT-4 Turbo0.8 USD per 1M Tokensestimated
Claude 3 Opus0.86 USD per 1M Tokensestimated
GPT-40.84 USD per 1M Tokensestimated

Max plan · API

GET https://viral-chart.com/api/posts/955504180702.json
GET https://viral-chart.com/api/charts/955504180702.json
GET https://viral-chart.com/api/charts/955504180702.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 955504180702.

Approximate values. Our two readings of this chart agreed only in part (confidence 0.35 of 1), so check the original before you quote a number. The API marks it lowConfidence, and ?min_confidence=0.5 leaves it out.

PathReturnsPlan
GET/api/v1/charts/955504180702Title, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/955504180702/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/955504180702/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/955504180702/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Claude 3

More from Anthropic

Questions people ask

Where does this chart come from?

@ArtificialAnlys published it on Mar 4, 2024 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.