HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/allenai/allenai/OLMo-2-0325-32B

allenai/OLMo-2-0325-32B

family olmo · 2 variants · unknown

provider
allenai
released
—
huggingface
https://huggingface.co/allenai/OLMo-2-0325-32B
best scores
MMLU: 70.2DROP: 70.2AGIEval: 41.5GSM8K: 74.3MMLU-Pro: 23.9TriviaQA: 81.3AlpacaEval: 38.7BBH: 66.6IFEval: 66.9MATH: 41.2PopQA: 45.0

Best scores per benchmark

benchmarkcategorybest score
TriviaQAknowledge81.3
GSM8Kmath74.3
MMLUknowledge70.2
DROPreasoning70.2
IFEvalinstruction-following66.9
BBHreasoning66.6
PopQAknowledge45.0
AGIEvalreasoning41.5
MATHmath41.2
AlpacaEvalchat38.7
MMLU-Proknowledge23.9

Variants (2)

variantkindquantbitsvRAMdlorgyear
OLMo-2-0325-32Boriginalbf1616.04,572allenai2025
OLMo-2-0325-32B-SFToriginalbf1616.0820allenai2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.