1. Models
  2. DeepSeek
  3. Pass Rate Comparison Across Benchmarks
DeepSeekHugging Face · Aug 29, 2024 · official

Pass Rate Comparison Across Benchmarks

Pass rate comparison across three benchmarks

Hugging FaceDataBar chartDeepSeek-Prover and MathAll DeepSeek modelsDeepSeek-ProverV1DeepSeek-ProverV1.5DeepSeek-ProverV2GPT-fHyperTree Proof SearchLlemma-7BLlemma-34BReProver
Published by DeepSeek on Hugging Face, Aug 29, 2024. Source: huggingface.co

API · Max

Use this chart via API

On the Max plan you can pull this chart's numbers with the provenance of each one, as JSON or CSV, with its redraw spec, or call it from an agent over MCP. Chart id 289b7890546a.

PathReturnsPlan
GET/api/v1/charts/289b7890546aTitle, publisher, date, form, point count; with a Max key, the data linkOpen
GET/api/v1/charts/289b7890546a/dataEvery point with its provenance and confidence, plus the redraw spec. Add ?format=csv for CSVMax
GET/api/v1/charts/289b7890546a/render?view=1The draw-only view this page usesOpen
POST/mcpTool get_chart_data with this id, for Claude, Cursor and other agentsMax
curlMax
curl -s https://viral-chart.com/api/v1/charts/289b7890546a/data \
  -H "Authorization: Bearer $VIRALCHART_KEY"
Claude CodeMax
claude mcp add --transport http viralchart https://viral-chart.com/mcp \
  --header "Authorization: Bearer $VIRALCHART_KEY"

60 requests a minute per key; over that you get 429 with Retry-After. Up to 5 keys per account, made on your account page and shown once. Without Max, the data route answers 402 with a link to the plans. The numbers describe a chart its publisher owns, and every file carries a license note.

Chart data

The numbers behind it

14 points. Estimated from the image Redrawn natively, with a way to make one with your own numbers.

More charts about DeepSeek-Prover and Math

More from DeepSeek

Questions people ask

Where does this chart come from?

DeepSeek published it on Aug 29, 2024 on Hugging Face (huggingface.co). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. Open its data page and use Make one like this: it starts from this chart's numbers and takes yours.