microsoft/Phi-3.5-mini-instruct
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MATH | math | 86.2 | Math | medium | | Math | GSM8K (8-shot, CoT) | 86.2 | 54.4 | 84.2 | 82.4 | 84.9 | 82.4 | 91.3 | |
| TydiQA | knowledge | 62.2 | MEGA TyDi QA | medium | | MEGA TyDi QA | 62.2 | 55.9 | 54.0 | 63.7 | 54.5 | 65.6 | 63.6 | 81.8 | |
| MMLU | knowledge | 55.4 | Multilingual MMLU | medium | | Multilingual MMLU | 55.4 | 51.08 | 47.4 | 58.9 | 56.2 | 63.8 | 77.2 | 72.9 | |
| MGSM | math | 47.9 | MGSM | medium | | MGSM | 47.9 | 41.56 | 31.8 | 63.3 | 56.7 | 75.1 | 75.8 | 81.7 | |
| MMLU-Pro | knowledge | 30.9 | Multilingual MMLU-Pro | medium | | Multilingual MMLU-Pro | 30.9 | 30.21 | 15.0 | 34.0 | 21.4 | 43.0 | 57.9 | 53.2 | |
none scraped.