1. Chart data
  2. artificial-analysis
  3. AA-Omniscence Index: Score
artificial-analysisBenchmark bar chart · 79 points · Claude Fable 5

AA-Omniscence Index: Score

The numbers behind a chart artificial-analysis published, redrawn natively. Check the original, study the data, then make your own.

Estimated from the image 51%Claude Fable 5All Anthropic modelsAll chart data
Chart by artificial-analysis. Source: x.com

Simplified redraw

Drawn by us from the numbers below. Hover, tap or use the arrow keys.

A simplified redraw: it shows the numbers in our own look, not the look of the original. One accent marks what the chart is about. Values marked with ~ in the table are estimates.

The numbers

First 10 of 79 points are free
GroupSeriesValueSourceConf.
Claude 3.5 Haiku~43%Estimate0.50
Claude 3.5 SonnetAA-Omniscence Index Score43%Estimate0.97
Claude 3 OpusAA-Omniscence Index Score37%Estimate0.97
GPT-4oAA-Omniscence Index Score~30%Estimate0.30
Gemini 1.5 ProAA-Omniscence Index Score~27%Estimate0.30
GPT-4o miniAA-Omniscence Accuracy~26%Estimate0.30
Claude 3 SonnetAA-Omniscence Index Score~23%Estimate0.30
GPT-3.5 TurboAA-Omniscence Index Score~20%Estimate0.30
Gemini 1.5 FlashAA-Omniscence Index Score~14%Estimate0.30
Llama 3.1 70b~7%Estimate0.50

Max data, free with your email for now

See all 79 points and download the files

The full table, the JSON, a CSV and the agent skill file for this chart. These are Max in the plan; while this is a prototype your email unlocks them.

Unlocks all 35 giants. One email a week, leave any time. What you get · Log in

Llama 3.1 8bAA-Omniscence Accuracy~5%Estimate0.30
Gemini 1.0 Pro~4%Estimate0.50
Mistral LargeAA-Omniscence Index Score~2%Estimate0.30
Llama 3 70bAA-Omniscence Index Score1%Estimate0.97
Llama 3 8bAA-Omniscence Index Score1%Estimate0.97
Command R+AA-Omniscence Index Score1%Estimate0.90
Mistral Medium~0%Estimate0.50
GPT-4AA-Omniscence Index Score~0%Estimate0.30
Llama 2 70b~-4%Estimate0.50
Mixtral 8x7b~-10%Estimate0.50
Llama 2 13b~-10%Estimate0.50
Llama 2 7b~-33%Estimate0.50
Mistral 7bAA-Omniscence Index Score-37%Estimate0.97
GPT-4 TurboAA-Omniscence Index Score~27%Estimate0.50
Claude 3 HaikuAA-Omniscence Index Score~7%Estimate0.50
Llama 3.1 405BAA-Omniscence Index Score~5%Estimate0.50
Mixtral 8x22BAA-Omniscence Index Score~0%Estimate0.50
Gemma 2 27BAA-Omniscence Index Score~0%Estimate0.50
Qwen 2 72BAA-Omniscence Index Score~0%Estimate0.50
DeepSeek V2AA-Omniscence Index Score~-4%Estimate0.50
Phi-3 MiniAA-Omniscence Index Score~-10%Estimate0.50
Gemma 2 9BAA-Omniscence Index Score~-10%Estimate0.50
Llama 3.1 8BAA-Omniscence Index Score~-33%Estimate0.50
Command RAA-Omniscence Index Score~-37%Estimate0.50
Claude 3.5 SonnetAA-Omniscence Accuracy~67%Estimate0.50
Claude 3 OpusAA-Omniscence Accuracy~61%Estimate0.50
Gemini 1.5 ProAA-Omniscence Accuracy~59%Estimate0.50
GPT-4 TurboAA-Omniscence Accuracy~55%Estimate0.50
Claude 3 SonnetAA-Omniscence Accuracy~49%Estimate0.50
GPT-4AA-Omniscence Accuracy~48%Estimate0.50
Gemini 1.5 FlashAA-Omniscence Accuracy~48%Estimate0.50
GPT-3.5 TurboAA-Omniscence Accuracy~47%Estimate0.50
Claude 3 HaikuAA-Omniscence Accuracy~45%Estimate0.50
Llama 3.1 405BAA-Omniscence Accuracy~43%Estimate0.50
Mistral Large 2AA-Omniscence Accuracy~42%Estimate0.50
Command R+AA-Omniscence Accuracy~34%Estimate0.50
Llama 3 70BAA-Omniscence Accuracy~31%Estimate0.50
Llama 3 8BAA-Omniscence Accuracy~29%Estimate0.50
Mixtral 8x22BAA-Omniscence Accuracy~28%Estimate0.50
Gemma 2 27BAA-Omniscence Accuracy~27%Estimate0.50
Qwen 2 72BAA-Omniscence Accuracy~25%Estimate0.50
DeepSeek V2AA-Omniscence Accuracy~23%Estimate0.50
Phi-3 MiniAA-Omniscence Accuracy~22%Estimate0.50
Gemma 2 9BAA-Omniscence Accuracy~19%Estimate0.50
Mistral 7BAA-Omniscence Accuracy~17%Estimate0.50
Command RAA-Omniscence Accuracy~16%Estimate0.50
Mistral 7BAA-Omniscence Hallucination Rate~18%Estimate0.50
Command RAA-Omniscence Hallucination Rate~27%Estimate0.50
Llama 3.1 8BAA-Omniscence Hallucination Rate~28%Estimate0.50
Gemma 2 9BAA-Omniscence Hallucination Rate~30%Estimate0.50
Phi-3 MiniAA-Omniscence Hallucination Rate~30%Estimate0.50
DeepSeek V2AA-Omniscence Hallucination Rate~30%Estimate0.50
Qwen 2 72BAA-Omniscence Hallucination Rate~33%Estimate0.50
Gemma 2 27BAA-Omniscence Hallucination Rate~34%Estimate0.50
Mixtral 8x22BAA-Omniscence Hallucination Rate~34%Estimate0.50
Llama 3 8BAA-Omniscence Hallucination Rate~39%Estimate0.50
Llama 3 70BAA-Omniscence Hallucination Rate~53%Estimate0.50
Command R+AA-Omniscence Hallucination Rate~61%Estimate0.50
Mistral Large 2AA-Omniscence Hallucination Rate~64%Estimate0.50
Claude 3 HaikuAA-Omniscence Hallucination Rate~65%Estimate0.50
GPT-3.5 TurboAA-Omniscence Hallucination Rate~68%Estimate0.50
Gemini 1.5 FlashAA-Omniscence Hallucination Rate~73%Estimate0.50
Claude 3 SonnetAA-Omniscence Hallucination Rate~82%Estimate0.50
GPT-4AA-Omniscence Hallucination Rate~88%Estimate0.50
Claude 3 OpusAA-Omniscence Hallucination Rate~91%Estimate0.50
Gemini 1.5 ProAA-Omniscence Hallucination Rate~92%Estimate0.50
GPT-4 TurboAA-Omniscence Hallucination Rate~93%Estimate0.50
GPT-4oAA-Omniscence Hallucination Rate~95%Estimate0.50
Claude 3.5 SonnetAA-Omniscence Hallucination Rate~95%Estimate0.50
Download this chart's data

Max subscribers get the same data by API. API docs

JSONAgent skill file

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 4813c6fb0f4a.

See the Max planAPI docs
PathReturnsPlan
GET/api/v1/charts/4813c6fb0f4aTitle, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/4813c6fb0f4a/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/4813c6fb0f4a/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/4813c6fb0f4a/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

Make one like this

This chart's shape, your numbers.

Live preview. Everything stays on your device.

Pick the form

A simplified form: our own look, not the look of the original. Your numbers start from this chart's data.

More data from Anthropic

All chart data
Estimated from the imageClaude 3.5 Sonnet benchmarksAnthropic · Table chart · 34 pointsEstimated from the imageSoftware engineeringAnthropic · Bar chart · 2 pointsEstimated from the imageNovel problem-solving by costAnthropic · Scatter plot · 3 pointsEstimated from the imageReplica 7.4Code Arena: WebDevarena · Bar chart · 15 pointsEstimated from the imageModel benchmarksAnthropic · Table chart · 31 pointsEstimated from the imageReplica 6.0Opus 4.8Anthropic · Table chart · 28 points

Questions people ask

How accurate are these numbers?

They are estimated from the image by two independent passes, with confidence 0.51 on a 0 to 1 scale. Printed numbers read well; values read off an axis can be a few percent off.

Can I reuse this data?

The numbers describe a chart that artificial-analysis published. The image, layout and styling belong to them. Use the numbers with a credit to the publisher, and make your picture from your own data.

How do I get the file?

The JSON, CSV and agent skill file are under the email gate on this page. In this prototype they are static files at /api/charts/4813c6fb0f4a.json and /api/charts/4813c6fb0f4a.skill.md.