MiniMaxAI/MiniMax-Text-01
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| GSM8K | math | 95.6 | GSM8k<sup>*</sup> | medium | | GSM8k<sup>*</sup> | 95.6 | **96.9** | 95.2 | 95.4 | 95.8 | 96.7 | 96.7 | 94.8 | |
| Chatbot Arena | chat | 92.4 | Arena-Hard | medium | | Arena-Hard | **92.4** | 87.6 | 85.3 | 72.7 | 81.2 | 91.4 | 63.5 | 89.1 | |
| HumanEval | coding | 90.2 | HumanEval | medium | | HumanEval | 90.2 | **93.7** | 86.6 | 89.6 | 86.6 | 92.1 | 89.0 | 86.9 | |
| DROP | reasoning | 89.2 | DROP<sup>*</sup> _(F1)_ | medium | | DROP<sup>*</sup> _(F1)_ | 89.2 | 88.8 | 89.2 | 89.3 | 85.0 | 91.0 | **92.5** | 87.8 | |
| MMLU | knowledge | 85.7 | MMLU<sup>*</sup> | medium | | MMLU<sup>*</sup> | 85.7 | 88.3 | 86.8 | 86.5 | 86.1 | 88.5 | **88.6** | 88.5 | |
| IFEval | instruction-following | 84.1 | IFEval _(avg)_ | medium | | IFEval _(avg)_ | 84.1 | **90.1** | 89.4 | 88.4 | 87.2 | 87.3 | 86.4 | 89.1 | |
| MATH | math | 76.6 | MATH<sup>*</sup> | medium | | MATH<sup>*</sup> | 76.6 | 74.1 | **84.6** | 83.9 | 81.8 | **84.6** | 73.8 | 77.4 | |
| MBPP | coding | 76.2 | MBPP + | medium | | MBPP + | 76.2 | 75.1 | 75.4 | 75.9 | 77.0 | **78.8** | 73.0 | 71.7 | |
| MMLU-Pro | knowledge | 74.4 | MMLU-Pro<sup>*</sup> | medium | | MMLU-Pro<sup>*</sup> | 74.4 | **78.0** | 75.8 | 76.4 | 71.1 | 75.9 | 73.3 | 75.7 | |
| SimpleQA | knowledge | 64.6 | C-SimpleQA | medium | | C-SimpleQA | 64.6 | 56.8 | 59.4 | 63.3 | 52.2 | 64.8 | 54.7 | **67.4** | |
| GPQA | reasoning | 46.0 | GPQA<sup>*</sup> _(diamond)_ | medium | | GPQA<sup>*</sup> _(diamond)_ | 46.0 | **65.0** | 59.1 | 62.1 | 49.0 | 59.1 | 50.7 | 54.4 | |
| SimpleQA | knowledge | 39.0 | SimpleQA | medium | | SimpleQA | **39.0** | 28.1 | 23.4 | 26.6 | 10.3 | 24.9 | 23.2 | 23.7 | |
none scraped.