family olmo · 1 variants · unknown
| benchmark | category | best score |
|---|---|---|
| PIQA | knowledge | 76.3 |
| HellaSwag | knowledge | 74.5 |
| BoolQ | knowledge | 73.1 |
| WinoGrande | knowledge | 68.2 |
| OpenBookQA | knowledge | 49.8 |
| ARC-Challenge | knowledge | 44.5 |
| TruthfulQA | safety | 33.9 |
| MMLU | knowledge | 31.5 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| OLMo-7B-Twin-2T | original | bf16 | 16.0 | 90 | allenai | 2024 |