unsloth/Olmo-3-32B-Think-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MATH | math | 95.6 | MATH | medium | | MATH | 95.6 | 95.9 | 96.1 | 95.4 | 96.7 | 80.2 | 87.4 | 51.5 | 49.2 | 92.6 | |
| HumanEval | coding | 90.0 | HumanEvalPlus | medium | | HumanEvalPlus | 90.0 | 91.6 | 91.4 | 91.2 | 90.6 | 82.6 | 79.2 | 67.5 | 44.4 | 92.3 | |
| BBH | reasoning | 88.8 | BigBenchHard | medium | | BigBenchHard | 88.8 | 89.1 | 89.8 | 90.6 | 91.1 | 80.9 | 82.4 | 66.0 | 65.6 | 89.7 | |
| AGIEval | reasoning | 85.9 | AGI Eval English | medium | | AGI Eval English | 85.9 | 87.8 | 88.2 | 90.0 | 92.2 | 78.9 | 76.9 | 70.9 | 68.4 | 88.1 | |
| MMLU | knowledge | 85.3 | MMLU | medium | | MMLU | 85.3 | 85.2 | 85.4 | 88.8 | 90.1 | 84.6 | 74.6 | 76.1 | 77.1 | 88.0 | |
| IFEval | instruction-following | 83.9 | IFEval | medium | | IFEval | 83.9 | 80.6 | 89.0 | 86.5 | 85.5 | 81.9 | 85.4 | 62.1 | 85.8 | 78.7 | |
| LiveCodeBench | coding | 75.8 | LiveCodeBench v3 | medium | | LiveCodeBench v3 | 75.8 | 81.9 | 83.5 | 90.2 | 84.8 | 49.9 | 39.0 | 28.7 | 10.6 | 79.5 | |
| AIME 2024 | math | 73.5 | AIME 2024 | medium | | AIME 2024 | 73.5 | 76.0 | 76.8 | 80.8 | 86.3 | 15.7 | 28.9 | 4.7 | 4.6 | 70.3 | |
| AlpacaEval | chat | 69.1 | AlpacaEval 2 LC | medium | | AlpacaEval 2 LC | 69.1 | 78.6 | 74.2 | 75.6 | 80.9 | 81.9 | 65.5 | 39.8 | 38.0 | 26.2 | |
| MBPP | coding | 66.7 | MBPP+ | medium | | MBPP+ | 66.7 | 67.2 | 68.0 | 70.6 | 66.2 | 66.6 | 65.7 | 61.2 | 49.0 | 70.1 | |
| AIME 2025 | math | 66.2 | AIME 2025 | medium | | AIME 2025 | 66.2 | 70.7 | 72.5 | 70.9 | 78.8 | 13.4 | 22.9 | 0.9 | 0.9 | 56.3 | |
| GPQA | reasoning | 55.7 | GPQA | medium | | GPQA | 55.7 | 57.6 | 58.1 | 67.3 | 67.4 | 44.6 | 45.0 | 39.9 | 36.4 | 61.8 | |
| IFBench | instruction-following | 37.0 | IFBench | medium | | IFBench | 37.0 | 34.4 | 47.6 | 37.3 | 55.1 | 36.7 | 31.3 | 27.8 | 36.4 | 23.8 | |
| PopQA | knowledge | 33.1 | PopQA | medium | | PopQA | 33.1 | 37.0 | 31.9 | 30.7 | 32.2 | 28.0 | 30.2 | 30.4 | 37.2 | 26.7 | |
none scraped.