family misc · 1 variants · unknown
| benchmark | category | best score |
|---|---|---|
| GSM8K | math | 72.4 |
| IFEval | instruction-following | 66.36 |
| HumanEval | coding | 62.3 |
| MMLU | knowledge | 55.08 |
| TruthfulQA | safety | 50.56 |
| DROP | reasoning | 47.87 |
| BBH | reasoning | 38.61 |
| MATH | math | 21.41 |
| PopQA | knowledge | 19.75 |
| AlpacaEval | chat | 17.99 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| OLMoE-1B-7B-0125-DPO | original | bf16 | 16.0 | 1,866 | allenai | 2025 |