allenai/Flex-code-2x7B-1T
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MATH | math | 62.5 | Math | medium | | Math | 62.5 | 44.3 | 50.6 | 24.1 | 42.0 | 45.6 | **53.1** | 42.6 | 28.0 | 50.7 | 15.8 | 41.8 | |
| BBH | reasoning | 38.1 | high | | Code | 40.5 | 39.4 | 29.5 | 14.5 | 27.4 | 38.1 | 6.0 | 45.1 | 28.2 | 48.0 | 21.0 | 30.7 | | |
| MMLU | knowledge | 29.5 | high | | Code | 40.5 | 39.4 | 29.5 | 14.5 | 27.4 | 38.1 | 6.0 | 45.1 | 28.2 | 48.0 | 21.0 | 30.7 | | |
| AGIEval | reasoning | 27.4 | high | | Code | 40.5 | 39.4 | 29.5 | 14.5 | 27.4 | 38.1 | 6.0 | 45.1 | 28.2 | 48.0 | 21.0 | 30.7 | | |
| MMLU-Pro | knowledge | 14.5 | high | | Code | 40.5 | 39.4 | 29.5 | 14.5 | 27.4 | 38.1 | 6.0 | 45.1 | 28.2 | 48.0 | 21.0 | 30.7 | |
none scraped.