HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/allenai/allenai/OLMo-7B-0424-Instruct-hf

allenai/OLMo-7B-0424-Instruct-hf

family olmo · 1 variants · unknown

provider: allenai
released: —
huggingface: https://huggingface.co/allenai/OLMo-7B-0424-Instruct-hf
best scores: MMLU: 47.5TruthfulQA: 25.7AlpacaEval: 70.4

Best scores per benchmark

benchmark	category	best score
AlpacaEval	chat	70.4
MMLU	knowledge	47.5
TruthfulQA	safety	25.7

Variants (1)

variant	kind	quant	bits	vRAM	dl	org	year
OLMo-7B-0424-Instruct-hf	original	bf16	16.0		60	allenai	2024

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.