microsoft/GRIN-MoE
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| OpenBookQA | knowledge | 89.8 | OpenBookQA | medium | | OpenBookQA | 89.8 | 89.6 | 85.8 | 88.6 | 82.6 | 91.8 | 86.0 | 95.2 | |
| PIQA | knowledge | 89.0 | PIQA | medium | | PIQA | 89.0 | 88.6 | 86.0 | 85.0 | 75.7 | 85.3 | 86.6 | 92.9 | |
| HellaSwag | knowledge | 83.7 | HellaSwag | medium | | HellaSwag | 83.7 | 83.8 | 70.4 | 79.0 | 71.1 | 82.6 | 78.8 | 91.7 | |
| BoolQ | knowledge | 83.4 | BoolQ | medium | | BoolQ | 83.4 | 84.6 | 77.6 | 82.7 | 80.9 | 89.1 | 79.1 | 90.6 | |
| CommonsenseQA | knowledge | 81.8 | CommonSenseQA | medium | | CommonSenseQA | 81.8 | 83.5 | 78.1 | 82.0 | 79.0 | 84.4 | 79.6 | 88.5 | |
| BBH | reasoning | 81.4 | BigBench-Hard | medium | | BigBench-Hard | 81.4 | 79.1 | 69.7 | 81.8 | 51.5 | 80.2 | 68.3 | 81.2 | |
| WinoGrande | knowledge | 81.4 | WinoGrande | medium | | WinoGrande | 81.4 | 81.3 | 62.0 | 75.3 | 65.0 | 83.3 | 68.8 | 89.3 | |
| MBPP | coding | 80.3 | MBPP | medium | | MBPP | 80.3 | 80.8 | 60.2 | 70.7 | 67.7 | 81.3 | 77.8 | 90.4 | |
| MMLU | knowledge | 79.4 | MMLU | medium | | MMLU | 79.4 | 78.9 | 70.5 | 76.2 | 66.5 | 80.2 | 71.4 | 86.9 | |
| TruthfulQA | safety | 74.5 | TruthfulQA | medium | | TruthfulQA | 74.5 | 77.5 | 60.1 | 67.4 | 63.2 | 81.9 | 85.8 | 85.6 | |
| HumanEval | coding | 74.4 | HumanEval | medium | | HumanEval | 74.4 | 70.7 | 37.8 | 39.6 | 60.4 | 78.7 | 62.2 | 92.1 | |
| TriviaQA | knowledge | 73.9 | TriviaQA | medium | | TriviaQA | 73.9 | 71.6 | 78.5 | 82.2 | 67.7 | 84.5 | 85.8 | 66.0 | |
| MedQA | domain | 70.4 | MedQA | medium | | MedQA | 70.4 | 70.5 | 62.2 | 67.9 | 60.5 | 78.5 | 63.4 | 88.9 | |
| AGIEval | reasoning | 48.2 | AGIEval | medium | | AGIEval | 48.2 | 50.3 | 45.2 | 54.0 | 42.0 | 56.9 | 48.4 | 37.6 | |
none scraped.