1. Charts
  2. Model Accuracy Comparison
Mistral AIBlog · Jan 30, 2025 · official

Model Accuracy Comparison

Accuracy comparison across MMLU Pro and GPQA

BlogGrouped bar chartMistral SmallMistral-Small-2-27b-it-Instruct-2501Gemma-Small-2-24b-it-InstructQwen2.5-32B-InstructLlama3.3-70B-Instructgpt-4o-mini-2024-07-18
Published by Mistral AI on Blog, Jan 30, 2025. Source: mistral.ai

API

Not in the API yet

We have not read this chart's numbers yet, so the API has nothing to return for it. Charts with numbers read are on the data page, and each one can be called by id.

Charts with dataAPI docs

More charts about Mistral Small

Mistral Small: Score vs. Output Length
OfficialHugging Face · Mistral AIJul 15, 2026
Score vs. Output Length
Data
Mistral Small: Performance Comparison Across Internal Models
OfficialHugging Face · Mistral AIJul 15, 2026
Performance Comparison Across Internal Models
Data
Mistral Small: Score vs. Output Length
OfficialHugging Face · Mistral AIJul 15, 2026
Score vs. Output Length
Data
Mistral Small: Score vs. Output Length
OfficialHugging Face · Mistral AIJul 15, 2026
Score vs. Output Length
Data
Mistral Small: Performance / Mistral GPQA-Diamond
OfficialBlog · Mistral AIMar 17, 2025
Performance / Mistral GPQA-Diamond
Mistral Small: Performance / MMLU-Pro vs Latency
OfficialBlog · Mistral AIJan 30, 2025
Performance / MMLU-Pro vs Latency

More from Mistral AI

Mistral Large: LMArena ELO Score
OfficialX · Mistral AIDec 2, 2025
LMArena ELO Score441.6K views · 572 likes
Data
Mistral Large: Artificial Analysis Cyber Index v1
OfficialX · Mistral AIOct 6, 2026
Artificial Analysis Cyber Index v1134.5K views · 2.8K likes
Data
Mistral Large: Artificial Analysis - AutomationBench
OfficialX · Mistral AIOct 7, 2026
Artificial Analysis - AutomationBench42.7K views · 863 likes
Data
Mistral Large: Vals.ai - Harvey's Legal Agent Benchmark
OfficialX · Mistral AIOct 7, 2026
Vals.ai - Harvey's Legal Agent Benchmark7.1K views · 111 likes
Data
Mistral Large: Artificial Analysis - DeepSWE 1.1
OfficialBlog · Mistral AIOct 6, 2026
Artificial Analysis - DeepSWE 1.1
Mistral Large: Code Benchmarks - Terminal-Bench 4.0
OfficialBlog · Mistral AIOct 6, 2026
Code Benchmarks - Terminal-Bench 4.0

Questions people ask

Where does this chart come from?

Mistral AI published it on Jan 30, 2025 on Blog (mistral.ai). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. The maker on any chart page redraws this type with your own numbers and words.