mistralai/Ministral-8B-Instruct-2410
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| WinoGrande | knowledge | 74.2 | low | | Mistral 7B Base | 62.5 | 42.5 | 74.2 | 67.9 | 62.5 | | |
| MMLU | knowledge | 62.5 | low | | Mistral 7B Base | 62.5 | 42.5 | 74.2 | 67.9 | 62.5 | | |
| TriviaQA | knowledge | 62.5 | low | | Mistral 7B Base | 62.5 | 42.5 | 74.2 | 67.9 | 62.5 | | |
| MBPP | coding | 50.2 | low | | Mistral 7B Instruct v0.3 | 50.2 | 38.4 | 13.2 | | |
| Chatbot Arena | chat | 44.3 | low | | Mistral 7B Instruct v0.3 | 6.7 | 44.3 | 33.1 | | |
| AGIEval | reasoning | 42.5 | low | | Mistral 7B Base | 62.5 | 42.5 | 74.2 | 67.9 | 62.5 | | |
| WildBench | chat | 33.1 | low | | Mistral 7B Instruct v0.3 | 6.7 | 44.3 | 33.1 | | |
| GSM8K | math | 32.0 | low | | Mistral 7B Base | 26.8 | 32.0 | | |
| HumanEval | coding | 26.8 | low | | Mistral 7B Base | 26.8 | 32.0 | | |
| MATH | math | 13.2 | low | | Mistral 7B Instruct v0.3 | 50.2 | 38.4 | 13.2 | | |
| MT-Bench | chat | 6.7 | low | | Mistral 7B Instruct v0.3 | 6.7 | 44.3 | 33.1 | |
none scraped.