1. Charts
  2. MMLU vs. Price
A
@ArtificialAnlysX · Jul 24, 2024

MMLU vs. Price

@ArtificialAnlys's scatter plot drew 6K views on X: 0.5x @artificialanlys's median post and #908 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

MMLU vs. Price: Quality benchmark comparison

XDataScatter plotMistral LargeGPT-4oGPT-4o miniLlama 3.1 (8B)Mistral NeMoGemini 1.5 FlashMixtral 8x22BLlama 3.1 (70B)
Published by @ArtificialAnlys on X, Jul 24, 2024. Source: x.com
45/ 100

ViralChart score

Small but loved

Fewer views than the median post but a higher engagement rate: a smaller crowd that acted on it.

#698 of 1,162 AI chart posts we hold · #204 of 491 @artificialanlys posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

The post sits in the Small but loved quadrant at #698 of 1,162 AI chart posts.

A 0.43% save rate lands at the 99th percentile among AI chart posts, 5.7x their 0.076% median.

Its 6K views sit at 0.52x @ArtificialAnlys's 11.4K median, #317 of 491 @ArtificialAnlys posts.

The score of 45 places it #698 of 1,162 AI chart posts and #204 of 491 @ArtificialAnlys posts.

top 1%save rate

0.434% of viewers bookmarked it to come back to. The median post gets 0.076%.

top 16%engagement rate

1.22% of viewers liked, reposted, quoted or replied. The median post gets 0.73%.

0.3xthe median scatter plot post

Across 187 scatter plot posts we hold, the median gets 22.4K views.

0.5x@artificialanlys's median post

6K views, where @artificialanlys's typical post gets 11.4K.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 491 from @artificialanlys.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #698 of 1,162

Views6K#908bottom 22%
Likes61#832bottom 29%
Engagement rate1.22%#186top 16%
Save rate0.434%#10top 1%

Among 491 @artificialanlys posts

Score #204 of 491

Views6K#317bottom 36%
Likes61#263bottom 47%
Engagement rate1.22%#96top 19%
Save rate0.434%#5top 1%

Growth

One read so far

Views6K
Age at our read810 days
Views per day of life7views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@artificialanlys's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Jul 24, 2024

@ArtificialAnlys plots MMLU against price for 12 models

A 12-model scatter plot from July 24, 2024 drew 6K views and a 0.43% save rate, 5.7x the AI chart median.

What happened

@ArtificialAnlys posted a scatter plot on MMLU vs. Price on July 24, 2024. It was the account's only post that day.

The numbers

It reached 6K views, #908 of 1,162 AI chart posts, and #317 of 491 @ArtificialAnlys posts by views. Its score of 45 ranks #698 of 1,162 AI chart posts.

The lesson

A 0.43% save rate at the 99th percentile shows readers bookmark this 12-model scatter plot at 5.7x the AI chart median. The 6K views against a 39.9K AI chart median show saves and reach moved apart here.

What it means

At #204 of 491 @ArtificialAnlys posts by score and 0.52x the account's 11.4K median views, this chart post sits below the publisher's own reach. Its 99th percentile save rate is the counterweight.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

13 points read off this chart

Estimated from the image 43%
SeriesGroupValueRead
GPT-4o mini82 %estimated
Llama 3.1 (70B)86 %estimated
Mistral Large 284 %estimated
Gemini 1.5 Pro85 %estimated
Gemini 1.5 Flash78 %estimated
Llama 3.1 (8B)69 %estimated
Llama 3.1 (405B)88 %estimated
Mistral 8x22B77 %estimated
Mistral NeMo68 %estimated
Claude 3.5 Sonnet88 %estimated
GPT-4o90 %estimated
Mistral Large85 %estimated

Showing 12 of 13. All points, the redraw and the maker

Max plan · API

GET https://viral-chart.com/api/posts/fb2b39ab6a70.json
GET https://viral-chart.com/api/charts/fb2b39ab6a70.json
GET https://viral-chart.com/api/charts/fb2b39ab6a70.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id fb2b39ab6a70.

Approximate values. Our two readings of this chart agreed only in part (confidence 0.43 of 1), so check the original before you quote a number. The API marks it lowConfidence, and ?min_confidence=0.5 leaves it out.

PathReturnsPlan
GET/api/v1/charts/fb2b39ab6a70Title, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/fb2b39ab6a70/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/fb2b39ab6a70/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/fb2b39ab6a70/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Mistral Large

More from Mistral AI

Questions people ask

Where does this chart come from?

@ArtificialAnlys published it on Jul 24, 2024 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.