HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/allenai/allenai/OLMo-7B-Instruct

allenai/OLMo-7B-Instruct

family olmo · 1 variants · unknown

provider: allenai
released: —
huggingface: https://huggingface.co/allenai/OLMo-7B-Instruct
best scores: MMLU: 28.3TruthfulQA: 31.6AlpacaEval: 46.8

Best scores per benchmark

benchmark	category	best score
AlpacaEval	chat	46.8
TruthfulQA	safety	31.6
MMLU	knowledge	28.3

Variants (1)

variant	kind	quant	bits	vRAM	dl	org	year
OLMo-7B-Instruct	original	bf16	16.0		408	allenai	2024

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.