family olmo · 1 variants · unknown
| benchmark | category | best score |
|---|---|---|
| PIQA | knowledge | 77.2 |
| HellaSwag | knowledge | 76.2 |
| BoolQ | knowledge | 75.4 |
| WinoGrande | knowledge | 70.5 |
| OpenBookQA | knowledge | 51.2 |
| TruthfulQA | safety | 33.9 |
| MMLU | knowledge | 31.5 |
| ARC-Challenge | knowledge | 25.0 |
| GSM8K | math | 10.0 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| OLMo-7B-0424 | original | bf16 | 16.0 | 108 | allenai | 2024 |