mistralai/Mistral-Small-3.1-24B-Base-2503
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MMLU | knowledge | 81.01 | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | low | | **Small 3.1 24B Base** | **81.01%** | **56.03%** | 80.50% | **37.50%** | **59.27%** | |
| TriviaQA | knowledge | 80.5 | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | low | | **Small 3.1 24B Base** | **81.01%** | **56.03%** | 80.50% | **37.50%** | **59.27%** | |
| MMMU | multimodal | 59.27 | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | low | | **Small 3.1 24B Base** | **81.01%** | **56.03%** | 80.50% | **37.50%** | **59.27%** | |
| MMLU-Pro | knowledge | 56.03 | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | low | | **Small 3.1 24B Base** | **81.01%** | **56.03%** | 80.50% | **37.50%** | **59.27%** | |
| GPQA | reasoning | 37.5 | MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | low | | **Small 3.1 24B Base** | **81.01%** | **56.03%** | 80.50% | **37.50%** | **59.27%** | |
none scraped.