1. Charts
  2. Multilingual MMLU Performance vs Parameters
Mistral AIBlog · Jul 24, 2024 · official

Multilingual MMLU Performance vs Parameters

Best performance/size ratio highlighted

BlogScatter plotMistral LargeMistral Large 2Llama 3.1 405BLlama 3.1 70B
Published by Mistral AI on Blog, Jul 24, 2024. Source: mistral.ai

API

Not in the API yet

We have not read this chart's numbers yet, so the API has nothing to return for it. Charts with numbers read are on the data page, and each one can be called by id.

More charts about Mistral Large

More from Mistral AI

Questions people ask

Where does this chart come from?

Mistral AI published it on Jul 24, 2024 on Blog (mistral.ai). We keep it here, with the publisher and date credited as text, so you can study it without leaving.

Can I make a chart like this?

Use the format, not the picture. The maker on any chart page redraws this type with your own numbers and words.