HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMo-2-0325-32B

allenai/OLMo-2-0325-32B

kind
original
quant
bf16 (16-bit)
family
olmo
modality
text-generation
root model
allenai/OLMo-2-0325-32B
provider
allenai
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
4,572
likes
66
created
—
last modified
2025-04-29T18:51:42+00:00 (2025)
huggingface
https://huggingface.co/allenai/OLMo-2-0325-32B
tags
transformerssafetensorsolmo2text-generationenarxiv:2501.00656license:apache-2.0endpoints_compatibleregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
TriviaQAknowledge81.3low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |
MMLUknowledge55.7low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |
DROPreasoning45.6low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |
AGIEvalreasoning41.5low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |
GSM8Kmath28.1low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |
MMLU-Proknowledge23.9low| Llama-2-13B | 1.6 · 10^23 | 54.1 | 67.3 | 83.9 | 74.9 | 55.7 | 45.6 | 38.4 | 41.5 | 28.1 | 23.9 | 81.3 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.