microsoft/Phi-4-mini-instruct
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| GSM8K | math | 88.6 | GSM8K (8-shot, CoT) | medium | | GSM8K (8-shot, CoT) | 88.6 | 76.9 | 75.6 | 80.1 | 80.6 | 88.7 | 81.9 | 82.4 | 84.3 | 84.9 | 91.3 | |
| ARC-Challenge | knowledge | 83.7 | ARC Challenge (10-shot) | medium | | ARC Challenge (10-shot) | 83.7 | 84.6 | 76.1 | 80.3 | 82.6 | 90.1 | 82.7 | 83.1 | 79.4 | 89.8 | 93.5 | |
| BoolQ | knowledge | 81.2 | BoolQ (2-shot) | medium | | BoolQ (2-shot) | 81.2 | 77.7 | 71.4 | 79.4 | 65.4 | 80.0 | 80.5 | 82.8 | 79.3 | 85.7 | 88.7 | |
| OpenBookQA | knowledge | 79.2 | OpenBookQA (10-shot) | medium | | OpenBookQA (10-shot) | 79.2 | 81.2 | 72.6 | 79.8 | 79.3 | 82.6 | 80.2 | 84.8 | 79.8 | 90.0 | 90.0 | |
| PIQA | knowledge | 77.6 | PIQA (5-shot) | medium | | PIQA (5-shot) | 77.6 | 78.2 | 68.2 | 73.2 | 72.6 | 76.2 | 81.2 | 83.2 | 78.3 | 83.7 | 88.7 | |
| BBH | reasoning | 70.4 | BigBench Hard (0-shot, CoT) | medium | | BigBench Hard (0-shot, CoT) | 70.4 | 63.1 | 55.4 | 51.2 | 56.2 | 72.4 | 53.3 | 63.4 | 55.5 | 65.7 | 80.4 | |
| HellaSwag | knowledge | 69.1 | HellaSwag (5-shot) | medium | | HellaSwag (5-shot) | 69.1 | 72.2 | 77.2 | 74.6 | 74.6 | 80.0 | 73.5 | 72.8 | 80.9 | 87.1 | 88.7 | |
| MMLU | knowledge | 67.3 | MMLU (5-shot) | medium | | MMLU (5-shot) | 67.3 | 65.5 | 61.8 | 60.8 | 65.0 | 72.6 | 63.0 | 68.1 | 65.0 | 71.3 | 77.2 | |
| WinoGrande | knowledge | 67.0 | Winogrande (5-shot) | medium | | Winogrande (5-shot) | 67.0 | 72.2 | 53.2 | 59.8 | 63.3 | 71.1 | 63.1 | 64.7 | 65.4 | 74.0 | 76.9 | |
| TruthfulQA | safety | 66.4 | TruthfulQA (MC2) (10-shot) | medium | | TruthfulQA (MC2) (10-shot) | 66.4 | 65.2 | 59.2 | 62.9 | 64.3 | 69.4 | 63.0 | 69.2 | 64.1 | 76.6 | 78.2 | |
| MATH | math | 64.0 | MATH (0-shot, CoT) | medium | | MATH (0-shot, CoT) | 64.0 | 49.8 | 46.7 | 41.8 | 61.7 | 60.4 | 41.6 | 47.6 | 46.1 | 51.3 | 70.2 | |
| MGSM | math | 63.9 | MGSM (0-shot, CoT) | medium | | MGSM (0-shot, CoT) | 63.9 | 49.6 | 44.6 | 44.6 | 53.5 | 64.5 | 56.7 | 56.7 | 58.6 | 75.1 | 81.7 | |
| MMLU-Pro | knowledge | 52.8 | MMLU-Pro (0-shot, CoT) | medium | | MMLU-Pro (0-shot, CoT) | 52.8 | 47.4 | 39.2 | 35.3 | 44.7 | 56.2 | 36.6 | 44.0 | 40.9 | 50.1 | 62.8 | |
| MMLU | knowledge | 49.3 | Multilingual MMLU (5-shot) | medium | | Multilingual MMLU (5-shot) | 49.3 | 51.8 | 48.1 | 46.4 | 55.9 | 64.4 | 53.7 | 56.2 | 54.5 | 63.8 | 72.9 | |
| Chatbot Arena | chat | 32.8 | Arena Hard | medium | | Arena Hard | 32.8 | 34.4 | 17.0 | 26.9 | 32.0 | 55.5 | 37.3 | 25.7 | 42.7 | 43.7 | 53.7 | |
| GPQA | reasoning | 25.2 | GPQA (0-shot, CoT) | medium | | GPQA (0-shot, CoT) | 25.2 | 26.6 | 24.3 | 24.4 | 23.4 | 30.6 | 26.3 | 26.3 | 29.9 | 39.1 | 41.1 | |
none scraped.