HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/allenai/allenai/OLMo-7B-0724-Instruct-hf

allenai/OLMo-7B-0724-Instruct-hf

family olmo · 1 variants · unknown

provider: allenai
released: —
huggingface: https://huggingface.co/allenai/OLMo-7B-0724-Instruct-hf
best scores: MMLU: 50.8TruthfulQA: 28.4AlpacaEval: 70.9

Best scores per benchmark

benchmark	category	best score
AlpacaEval	chat	70.9
MMLU	knowledge	50.8
TruthfulQA	safety	28.4

Variants (1)

variant	kind	quant	bits	vRAM	dl	org	year
OLMo-7B-0724-Instruct-hf	original	bf16	16.0		1,066	allenai	2024

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.