HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/allenai/allenai/OLMo-2-1124-7B-SFT

allenai/OLMo-2-1124-7B-SFT

family olmo · 4 variants · unknown

provider
allenai
released
—
huggingface
https://huggingface.co/allenai/OLMo-2-1124-7B-SFT
best scores
AlpacaEval: 43.7BBH: 2.5DROP: 58.8GSM8K: 79.7IFEval: 69.9MATH: 29.8MMLU: 69.1PopQA: 28.3

Best scores per benchmark

benchmarkcategorybest score
GSM8Kmath79.7
IFEvalinstruction-following69.9
MMLUknowledge69.1
DROPreasoning58.8
AlpacaEvalchat43.7
MATHmath29.8
PopQAknowledge28.3
BBHreasoning2.5

Variants (4)

variantkindquantbitsvRAMdlorgyear
OLMo-2-1124-7B-DPOoriginalbf1616.02,847allenai2025
OLMo-2-1124-7B-RMoriginalbf1616.099allenai2025
OLMo-2-1124-7B-RM-Previeworiginalbf1616.098allenai2025
OLMo-2-1124-7B-DPO-Previeworiginalbf1616.053allenai2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.