HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/allenai/allenai/OLMo-7B-0724-hf

allenai/OLMo-7B-0724-hf

family olmo · 1 variants · unknown

provider: allenai
released: —
huggingface: https://huggingface.co/allenai/OLMo-7B-0724-hf
best scores: BoolQ: 75.4HellaSwag: 76.2OpenBookQA: 51.2PIQA: 77.2WinoGrande: 70.5TruthfulQA: 33.9MMLU: 31.5GSM8K: 10.0ARC-Challenge: 25.0

Best scores per benchmark

benchmark	category	best score
PIQA	knowledge	77.2
HellaSwag	knowledge	76.2
BoolQ	knowledge	75.4
WinoGrande	knowledge	70.5
OpenBookQA	knowledge	51.2
TruthfulQA	safety	33.9
MMLU	knowledge	31.5
ARC-Challenge	knowledge	25.0
GSM8K	math	10.0

Variants (1)

variant	kind	quant	bits	vRAM	dl	org	year
OLMo-7B-0724-hf	original	bf16	16.0		1,139	allenai	2024

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.