HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/allenai/allenai/OLMo-2-0425-1B

allenai/OLMo-2-0425-1B

family olmo · 4 variants · unknown

provider
allenai
released
—
huggingface
https://huggingface.co/allenai/OLMo-2-0425-1B
best scores
BBH: 66.6DROP: 70.2GSM8K: 74.3MATH: 41.2MMLU: 70.2AlpacaEval: 2.4IFEval: 25.3PopQA: 12.1

Best scores per benchmark

benchmarkcategorybest score
GSM8Kmath74.3
DROPreasoning70.2
MMLUknowledge70.2
BBHreasoning66.6
MATHmath41.2
IFEvalinstruction-following25.3
PopQAknowledge12.1
AlpacaEvalchat2.4

Variants (4)

variantkindquantbitsvRAMdlorgyear
OLMo-2-0425-1Boriginalbf1616.02467,732allenai2025
OLMo-2-0425-1B-SFToriginalbf1616.012,330allenai2025
Bolmo-1Boriginalbf1616.0599allenai2026
OLMo-2-0425-1B-GGUFggufgguf16.0199allenai2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.