1. Models
  2. Anthropic
  3. Output Tokens Used to Run Evaluations in Artificial
A
@ArtificialAnlysX · Jul 23, 2025

Output Tokens Used to Run Evaluations in Artificial

@ArtificialAnlys's bar chart drew 62.1K views on X: 5.4x @artificialanlys's median post and #481 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

Token usage varies widely across AI models in evaluations

Published by @ArtificialAnlys on X, Jul 23, 2025. Source: x.com
68/ 100

ViralChart score

Reached and resonated

More views and a higher engagement rate than the median post: it travelled and people acted on it.

#277 of 1,162 AI chart posts we hold · #74 of 491 @artificialanlys posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

The post sits in the Reached and resonated quadrant at #277 of 1,162 AI chart posts.

Its 62.1K views sit 5.4x above the 11.4K median for @ArtificialAnlys posts.

A 0.22% save rate lands in the 92nd percentile among AI chart posts, against a 0.076% median.

The score of 68 places it at #277 of 1,162 AI chart posts and #74 of 491 @ArtificialAnlys posts.

5.4x@artificialanlys's median post

62.1K views, where @artificialanlys's typical post gets 11.4K.

2charts in this one post

The numbers belong to the post, so every chart in it shares them and it is ranked once.

top 8%save rate

0.217% of viewers bookmarked it to come back to. The median post gets 0.076%.

top 22%engagement rate

1.09% of viewers liked, reposted, quoted or replied. The median post gets 0.73%.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 491 from @artificialanlys.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #277 of 1,162

Views62.1K#481top 41%
Likes566#417top 36%
Engagement rate1.09%#259top 22%
Save rate0.217%#93top 8%

Among 491 @artificialanlys posts

Score #74 of 491

Views62.1K#121top 25%
Likes566#115top 23%
Engagement rate1.09%#134top 27%
Save rate0.217%#46top 9%

Growth

One read so far

Views62.1K
Age at our read447 days
Views per day of life139views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@artificialanlys's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Jul 23, 2025

@ArtificialAnlys charts output tokens used to run evaluations

A bar chart of token usage across 18 models drew 62.1K views and a 0.22% save rate, in the 92nd percentile among AI chart posts.

What happened

On July 23, 2025, @ArtificialAnlys posted a bar chart on output tokens used to run evaluations in Artificial, with 18 models shown. The post carried 2 charts, the other being the Artificial Analysis Intelligence Index, and it was the account's only post that day.

The numbers

It reached 62.1K views, ranking #481 of 1,162 AI chart posts and #121 of 491 @ArtificialAnlys posts by views. Its score of 68 ranks #277 of 1,162 AI chart posts and #74 of 491 @ArtificialAnlys posts.

The lesson

A 0.22% save rate, the 92nd percentile among AI chart posts, came with 18 models shown across 2 charts. The chart shows Reasoning Tokens (Magistral Small) at 130 and Reasoning Tokens (Grok 4 (May 25)) at 110.

What it means

At 5.4x the 11.4K median for @ArtificialAnlys posts, this chart post reached well above the account's typical views. Its 0.22% save rate against the 0.076% median among AI chart posts shows saves running well above that median.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Data and API

36 points read off this chart

Estimated from the image 64%
SeriesGroupValueRead
Reasoning TokensMagistral Small130 Mprinted
Answer TokensMagistral Small140 Mestimated
Reasoning TokensGrok 4 (May 25)110 Mprinted
Answer TokensGrok 4 (May 25)110 Mestimated
Reasoning TokensDeepSeek R1 0528 (May 25)91 Mprinted
Answer TokensDeepSeek R1 0528 (May 25)99 Mestimated
Reasoning TokensGemini 2.5 Pro85 Mprinted
Answer TokensGemini 2.5 Pro97 Mestimated
Reasoning TokensGemini 2.5 Flash (Reasoning)76 Mprinted
Answer TokensGemini 2.5 Flash (Reasoning)91 Mestimated
Reasoning TokensQwen3 235B (Jul 25)71 Mprinted
Answer TokensQwen3 235B (Jul 25)74 Mestimated

Showing 12 of 36. All points, the redraw and the maker

Max plan · API

GET https://viral-chart.com/api/posts/602bc38b392b.json
GET https://viral-chart.com/api/charts/602bc38b392b.json
GET https://viral-chart.com/api/charts/602bc38b392b.skill.md

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 602bc38b392b.

PathReturnsPlan
GET/api/v1/charts/602bc38b392bTitle, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/602bc38b392b/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/602bc38b392b/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/602bc38b392b/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about Claude 4

More from Anthropic

Questions people ask

Where does this chart come from?

@ArtificialAnlys published it on Jul 23, 2025 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.