unsloth/Olmo-3.1-32B-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| IFEval | instruction-following | 87.7 | IFEval | medium | | IFEval | 87.7 | 87.3 | 88.8 | 70.4 | 87.5 | 88.1 | 81.9 | 85.4 | 62.1 | 85.8 | |
| HumanEval | coding | 80.8 | HumanEvalPlus | medium | | HumanEvalPlus | 80.8 | 85.7 | 86.7 | 42.9 | 83.9 | 89.3 | 82.6 | 79.2 | 67.5 | 44.4 | |
| MMLU | knowledge | 79.0 | MMLU | medium | | MMLU | 79.0 | 81.9 | 80.9 | 70.2 | 85.8 | 88.7 | 84.6 | 74.6 | 76.1 | 77.1 | |
| MATH | math | 74.4 | MATH | medium | | MATH | 74.4 | 86.6 | 93.4 | 36.2 | 84.3 | 95.1 | 80.2 | 87.4 | 51.5 | 49.2 | |
| AGIEval | reasoning | 71.7 | AGI Eval English | medium | | AGI Eval English | 71.7 | 79.4 | 79.5 | 61.6 | 82.4 | 89.4 | 78.9 | 76.9 | 70.9 | 68.4 | |
| BBH | reasoning | 69.0 | BigBenchHard | medium | | BigBenchHard | 69.0 | 82.1 | 84.0 | 57.0 | 80.4 | 89.0 | 80.9 | 82.4 | 66.0 | 65.6 | |
| MBPP | coding | 61.5 | MBPP+ | medium | | MBPP+ | 61.5 | 63.6 | 65.1 | 45.8 | 67.9 | 69.0 | 66.6 | 65.7 | 61.2 | 49.0 | |
| AlpacaEval | chat | 42.2 | AlpacaEval 2 LC | medium | | AlpacaEval 2 LC | 42.2 | 69.7 | 59.8 | 19.9 | 67.9 | 84.3 | 81.9 | 65.5 | 39.8 | 38.0 | |
| GPQA | reasoning | 41.3 | GPQA | medium | | GPQA | 41.3 | 47.9 | 48.6 | 27.9 | 54.4 | 61.4 | 44.6 | 45.0 | 39.9 | 36.4 | |
| LiveCodeBench | coding | 35.4 | LiveCodeBench v3 | medium | | LiveCodeBench v3 | 35.4 | 49.6 | 54.7 | 9.7 | 57.5 | 70.2 | 49.9 | 39.0 | 28.7 | 10.6 | |
| IFBench | instruction-following | 29.7 | IFBench | medium | | IFBench | 29.7 | 36.3 | 39.7 | 26.0 | 31.3 | 37.2 | 36.7 | 31.3 | 27.8 | 36.4 | |
| PopQA | knowledge | 23.7 | PopQA | medium | | PopQA | 23.7 | 28.5 | 25.0 | 33.5 | 25.9 | 25.7 | 28.0 | 30.2 | 30.4 | 37.2 | |
| AIME 2024 | math | 12.7 | AIME 2024 | medium | | AIME 2024 | 12.7 | 35.2 | 67.8 | 0.31 | 27.9 | 75.4 | 15.7 | 28.9 | 4.7 | 4.6 | |
| AIME 2025 | math | 8.2 | AIME 2025 | medium | | AIME 2025 | 8.2 | 23.3 | 57.9 | 0.1 | 21.3 | 64.2 | 13.4 | 22.9 | 0.9 | 0.9 | |
none scraped.