Models
OpenAI
Cost to Run AI Evaluations

@ArtificialAnlysX · Aug 6, 2025

Cost to Run AI Evaluations

@ArtificialAnlys's bar chart drew 7.3K views on X: 0.6x @artificialanlys's median post and #871 of 1,162 AI chart posts we hold by views. Read Oct 12, 2026.

Cost to run all evaluations in AI Index

XData Bar chart gpt-oss All OpenAI models Grok 4 Gemini 2.5 Pro o3 Kimi K2 GPT-4.1 Llama 4 MaverickQwen3 235B A22B (Reasoning)Claude 4 Sonnet Thinking

@ArtificialAnlys: Cost to Run AI Evaluations — Published by @ArtificialAnlys on X, Aug 6, 2025. Source: x.com

32/ 100

ViralChart score

Small but loved

Fewer views than the median post but a higher engagement rate: a smaller crowd that acted on it.

#876 of 1,162 AI chart posts we hold · #284 of 491 @artificialanlys posts. Score = views 40%, likes 30%, engagement rate 15%, save rate 15%, each as a percentile of every AI chart post we hold.

Our read

It lands in Small but loved, with a score rank of #876 of 1,162 AI chart posts.

The post carries 3 charts, and every chart in the post shares the post's numbers.

Its score of 32 sits at #876 of 1,162 AI chart posts.

It ranked #2 of 2 posts from this account that day by views.

3charts in this one post

The numbers belong to the post, so every chart in it shares them and it is ranked once.

0.3xthe median bar chart post

Across 241 bar chart posts we hold, the median gets 25.6K views.

2posts from @artificialanlys that day

Part of a run of 2 posts on Aug 6, 2025. This one was #2 of 2 by views that day.

bottom 34%save rate

0.055% of viewers bookmarked it to come back to. The median post gets 0.076%.

Public X numbers from our read on Oct 12, 2026. Peers: 1,162 AI chart posts we hold and 491 from @artificialanlys.

Where it sits

Reach against resonance

Each dot is a post. Right is more views, up is a higher engagement rate. The lines are the medians, so the four corners are the four kinds of post.

Among 1,162 AI chart posts we hold

Score #876 of 1,162

Views	7.3K	#871	bottom 25%
Likes	54	#854	bottom 27%
Engagement rate	0.83%	#465	top 40%
Save rate	0.055%	#766	bottom 34%

Among 491 @artificialanlys posts

Score #284 of 491

Views	7.3K	#294	bottom 40%
Likes	54	#277	bottom 44%
Engagement rate	0.83%	#236	top 48%
Save rate	0.055%	#313	bottom 36%

Growth

One read so far

Views7.3K

Age at our read433 days

Views per day of life17views divided by days since it was posted

Dots are our reads. The dotted line from the day it was posted to our first read is a gap, not data.

@artificialanlys's posts over time

Every post from this account we hold, by date and views. This one is marked; the line is the running median of the last 10.

News · Aug 6, 2025

@ArtificialAnlys charts cost to run AI evaluations

A 3-chart post on evaluation cost reached 7.3K views and a 0.83% engagement rate, above the AI chart median.

What happened

@ArtificialAnlys posted a bar chart on August 6, 2025 about the cost to run all evaluations in AI Index, with 3 charts in the post. That day the account posted 2 posts, and the other one covered Artificial Analysis Intelligence Index v2.

The numbers

It drew 7.3K views, ranking #871 of 1,162 AI chart posts, against a median of 39.9K views among AI chart posts. Its score of 32 ranked #876 of 1,162 AI chart posts and #284 of 491 @ArtificialAnlys posts.

The lesson

A 3-chart post keeps its 0.83% engagement rate against a 0.055% save rate. The chart shows Input Cost (Grok 4) at 1641.5 and Input Cost (Llama 4 Maverick) at 10.

What it means

At #284 of 491 @ArtificialAnlys posts, this sits below the account's own median. The 7.3K views against the 39.9K median among AI chart posts show the gap this publisher's cost charts carry.

Written by ViralChart from public numbers read on Oct 12, 2026. Every number is checked against our data before it is shown.

Updates: what @artificialanlys posted next

Data and API

31 points read off this chart

Estimated from the image 44%

Series	Group	Value	Read
Input Cost	Grok 4	1641.5 USD	printed
Output Cost	Grok 4	1658 USD	estimated
Input Cost	Gemini 2.5 Pro	865 USD	estimated
Output Cost	Gemini 2.5 Pro	983 USD	estimated
Input Cost	Qwen3 235B A22B (Reasoning)	821 USD	estimated
Output Cost	Qwen3 235B A22B (Reasoning)	892 USD	estimated
Input Cost	Claude 4 Sonnet Thinking	541 USD	estimated
Output Cost	Claude 4 Sonnet Thinking	650 USD	estimated
Input Cost	o3	376 USD	estimated
Output Cost	o3	410 USD	estimated
Input Cost	o4-mini (high)	310 USD	estimated
Output Cost	o4-mini (high)	330 USD	estimated

Showing 12 of 31. All points, the redraw and the maker

Max plan · API

GET https://viral-chart.com/api/posts/4703fdb03d92.json
GET https://viral-chart.com/api/charts/4703fdb03d92.json
GET https://viral-chart.com/api/charts/4703fdb03d92.skill.md

Make one like this Open the post JSON Chart data JSON Skill file API docs

Static files in this prototype. The post JSON holds the public numbers, ranks, score, quadrant, our reads and, when checked, our copy.

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 4703fdb03d92.

Approximate values. Our two readings of this chart agreed only in part (confidence 0.44 of 1), so check the original before you quote a number. The API marks it lowConfidence, and ?min_confidence=0.5 leaves it out.

See the Max plan API docs

	Path	Returns	Plan
GET	`/api/v1/charts/4703fdb03d92`	Title, publisher, date, form, point count; with a Max key, the data link	Open
GET	`/api/v1/charts/4703fdb03d92/data`	Every point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSV	Max
GET	`/api/v1/charts/4703fdb03d92/render?view=1`	The draw-only view this page uses	Open
POST	`/mcp`	Tool get_chart_data with this id, for Claude, Cursor and other agents	Max

curlMax

curl -s https://viral-chart.com/api/v1/charts/4703fdb03d92/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"

Claude CodeMax

claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

More charts about gpt-oss

gpt-oss: Frontier Language Model Intelligence by Country

X · @ArtificialAnlysNov 11, 2025

Frontier Language Model Intelligence by Country59.3K views · 534 likes

Data

gpt-oss: GPT-OSS MoE Training Performance

X · @SemiAnalysis_Sep 26, 2026

GPT-OSS MoE Training Performance14.8K views · 9 likes

Data

gpt-oss: Output Tokens Used to Run Evaluations in Artificial

X · @ArtificialAnlysAug 6, 2025

Output Tokens Used to Run Evaluations in Artificial7.3K views · 54 likes

Data

gpt-oss: Artificial Analysis Intelligence vs Output Tokens

X · @ArtificialAnlysAug 6, 2025

Artificial Analysis Intelligence vs Output Tokens7.3K views · 54 likes

Data

gpt-oss: Intelligence vs. Total Parameters

X · @ArtificialAnlysMar 20, 2026

Intelligence vs. Total Parameters5.2K views · 27 likes

Data

OpenRouter · openrouter

Decline of DeepSeek's Dominance in OSS Token Market

More from OpenAI

OpenAI line chart: Output tokens by department

2.3x

OpenAI·Jun 2026

Output tokens by department

1.3M views5.4K likes0.5% eng.

Data

OpenAI annotated chart: Research paper benchmarking

2.9x

OpenAI·Apr 2025

Research paper benchmarking

1.1M views7K likes0.8% eng.

2.0x

OpenAI·Sep 2026

AI model performance

999.9K views4.8K likes0.6% eng.

Data

ChatGPT: Artificial Analysis Intelligence Index v4.1

OfficialX · OpenAIJul 30, 2026

Artificial Analysis Intelligence Index v4.121M views · 19.5K likes

Data

OfficialX · OpenAIMar 5, 2026

AI Model Benchmark Comparison7.2M views · 23.2K likes

Data

ChatGPT: GPT4 Turbo Benchmark Comparison

OfficialX · OpenAIApr 12, 2024

GPT4 Turbo Benchmark Comparison6.4M views · 6.7K likes

Data

OfficialX · OpenAISep 3, 2026

AI Model Benchmark Comparison5.4M views · 10.3K likes

Data

OfficialX · OpenAIDec 11, 2025

AI Model Benchmark Comparison2M views · 3.8K likes

Data

GPT-5.6: TerminalBench 2.1 AI Model Scores

OfficialX · OpenAIJun 26, 2026

TerminalBench 2.1 AI Model Scores1.9M views · 3.9K likes

Data

Questions people ask

Where does this chart come from?

@ArtificialAnlys published it on Aug 6, 2025 on X (x.com). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.