1. Models
  2. Google
  3. MATH Level 5 pass@1 comparison for Mistral Small
E
@EpochAIResearchX · Jan 31, 2025

MATH Level 5 pass@1 comparison for Mistral Small

@EpochAIResearch's dumbbell chart drew 366 views on X: 0.1x @epochairesearch's median post and #1,160 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

MATH Level 5 pass@1 for Mistral Small 3 compared to other models

XDataDumbbell chartGemma specialist modelsAll Google modelsQwen 2.5 32BGPT-4o mini (2024-07-18)Mistral Small 3Llama 3.3 70BGemma 2 27B
Published by @EpochAIResearch on X, Jan 31, 2025. Source: x.com
15/ 100

ViralChart score

Small but loved

Fewer views than the median post but a higher engagement rate: a smaller crowd that acted on it.

#1,123 of 1,162 AI chart posts we hold · #58 of 59 @epochairesearch posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

It sits in the Small but loved quadrant, at #1,123 of 1,162 AI chart posts.

Its 366 views sit at 0.07x @EpochAIResearch's 5.3K median, the account's #59 of 59 posts by views.

A 0.000% save rate lands in the bottom decile, 2nd percentile among AI chart posts against a 0.076% median.

The score of 15 puts it at #1,123 of 1,162 AI chart posts and #58 of 59 @EpochAIResearch posts.

0.1x@epochairesearch's median post

366 views, where @epochairesearch's typical post gets 5.3K.

0.0xthe median dumbbell chart post

Across 8 dumbbell chart posts we hold, the median gets 15.2K views.

bottom 2%save rate

0.000% of viewers bookmarked it to come back to. The median post gets 0.076%.

top 3%engagement rate

1.91% of viewers liked, reposted, quoted or replied. The median post gets 0.73%.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 59 from @epochairesearch.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #1,123 of 1,162

Views366#1,160bottom 1%
Likes6#1,151bottom 1%
Engagement rate1.91%#32top 3%
Save rate0.000%#1,160bottom 2%

Among 59 @epochairesearch posts

Score #58 of 59

Views366#59bottom 1%
Likes6#58bottom 3%
Engagement rate1.91%#16top 26%
Save rate0.000%#59bottom 3%

Growth

One read so far

Views366
Age at our read620 days
Views per day of life1views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@epochairesearch's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Jan 31, 2025

@EpochAIResearch dumbbell chart on Mistral Small 3 MATH Level 5

A 5-model dumbbell chart posted on January 31, 2025 drew 366 views and a 0.000% save rate.

What happened

@EpochAIResearch posted a dumbbell chart on January 31, 2025 comparing MATH Level 5 pass@1 for Mistral Small 3 against other models. It was one of 3 posts from the account that day, alongside a Mistral Small 3 benchmark accuracy chart at 4.9K views and a GPQA Diamond accuracy comparison at 376 views.

The numbers

The post reached 366 views, #1,160 of 1,162 AI chart posts, against a 39.9K median among AI chart posts. Its score of 15 ranks #1,123 of 1,162 AI chart posts and #58 of 59 @EpochAIResearch posts.

The lesson

A 0.000% save rate against a 0.076% median among AI chart posts marks this dumbbell chart as one readers did not keep. The 5-model comparison drew 366 views, 0.07x @EpochAIResearch's 5.3K median.

What it means

At #58 of 59 @EpochAIResearch posts by score, this chart sits below the account's own body of work. The 366 views against a 39.9K median among AI chart posts leave the gap wide.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

5 points read off this chart

Estimated from the image 30%
SeriesGroupValueRead
Qwen 2.5 32B54.5 %estimated
GPT-4o mini (2024-07-18)48.5 %estimated
Mistral Small 342.5 %estimated
Llama 3.3 70B38.5 %estimated
Gemma 2 27B28.5 %estimated

Max plan · API

GET https://viral-chart.com/api/posts/c6c38cd6534a.json
GET https://viral-chart.com/api/charts/c6c38cd6534a.json
GET https://viral-chart.com/api/charts/c6c38cd6534a.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id c6c38cd6534a.

Approximate values. Our two readings of this chart agreed only in part (confidence 0.30 of 1), so check the original before you quote a number. The API marks it lowConfidence, and ?min_confidence=0.5 leaves it out.

PathReturnsPlan
GET/api/v1/charts/c6c38cd6534aTitle, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/c6c38cd6534a/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/c6c38cd6534a/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/c6c38cd6534a/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Gemma specialist models

More from Google

Questions people ask

Where does this chart come from?

@EpochAIResearch published it on Jan 31, 2025 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.