HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/allenai/allenai/OLMo-2-1124-7B

allenai/OLMo-2-1124-7B

family olmo · 2 variants · unknown

provider
allenai
released
—
huggingface
https://huggingface.co/allenai/OLMo-2-1124-7B
best scores
MMLU: 55.7DROP: 45.6AGIEval: 41.5GSM8K: 28.1MMLU-Pro: 23.9TriviaQA: 81.3

Best scores per benchmark

benchmarkcategorybest score
TriviaQAknowledge81.3
MMLUknowledge55.7
DROPreasoning45.6
AGIEvalreasoning41.5
GSM8Kmath28.1
MMLU-Proknowledge23.9

Variants (2)

variantkindquantbitsvRAMdlorgyear
OLMo-2-1124-7Boriginalbf1616.050,375allenai2025
MolmoAct-7B-O-0812originalbf1616.058allenai2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.