family olmo · 5 variants · unknown
| benchmark | category | best score |
|---|---|---|
| MATH | math | 95.6 |
| PIQA | knowledge | 93.3 |
| HumanEval | coding | 90.0 |
| BBH | reasoning | 88.8 |
| IFEval | instruction-following | 87.7 |
| WinoGrande | knowledge | 87.5 |
| DROP | reasoning | 86.6 |
| HellaSwag | knowledge | 86.3 |
| AGIEval | reasoning | 85.9 |
| MMLU | knowledge | 85.3 |
| LiveCodeBench | coding | 75.8 |
| AIME 2024 | math | 73.5 |
| MBPP | coding | 69.8 |
| AlpacaEval | chat | 69.1 |
| MedQA | domain | 68.4 |
| AIME 2025 | math | 66.2 |
| MMLU-Pro | knowledge | 61.1 |
| GPQA | reasoning | 55.7 |
| BigCodeBench | coding | 48.1 |
| IFBench | instruction-following | 37.0 |
| PopQA | knowledge | 33.1 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Olmo-3-1125-32B | original | bf16 | 16.0 | 40,111 | allenai | 2025 | |
| Olmo-3.1-32B-Instruct-SFT | original | bf16 | 16.0 | 2,281 | allenai | 2026 | |
| Olmo-3-1125-32B-GGUF | gguf | gguf | 4.0 | 1,318 | lmstudio-community | 2025 | |
| Olmo-3-32B-Think-SFT | original | bf16 | 16.0 | 1,203 | allenai | 2026 | |
| Olmo-3-1125-32B-MLX-8bit | mlx | mlx | 65 | lmstudio-community | 2025 |