family olmo · 1 variants · unknown
| benchmark | category | best score |
|---|---|---|
| GSM8K | math | 74.3 |
| DROP | reasoning | 70.2 |
| MMLU | knowledge | 70.2 |
| IFEval | instruction-following | 66.9 |
| BBH | reasoning | 66.6 |
| PopQA | knowledge | 45.0 |
| MATH | math | 41.2 |
| AlpacaEval | chat | 38.7 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| OLMo-2-0325-32B-DPO | original | bf16 | 16.0 | 364 | allenai | 2025 |