HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/Falcon-H1-1.5B-Base

tiiuae/Falcon-H1-1.5B-Base

family falcon · 2 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/Falcon-H1-1.5B-Base
best scores
BBH: 46.57MMLU: 64.13HellaSwag: 66.76WinoGrande: 65.59GSM8K: 74.98MATH: 20.39GPQA: 29.11MMLU-Pro: 37.8HumanEval: 68.29MBPP: 65.08TruthfulQA: 45.98MATH-500: 74.0GPQA Diamond: 35.19LiveCodeBench: 17.61IFEval: 80.66AlpacaEval: 28.18MT-Bench: 8.46

Best scores per benchmark

benchmarkcategorybest score
IFEvalinstruction-following80.66
GSM8Kmath74.98
MATH-500math74.0
HumanEvalcoding68.29
HellaSwagknowledge66.76
WinoGrandeknowledge65.59
MBPPcoding65.08
MMLUknowledge64.13
BBHreasoning46.57
TruthfulQAsafety45.98
MMLU-Proknowledge37.8
GPQA Diamondreasoning35.19
GPQAreasoning29.11
AlpacaEvalchat28.18
MATHmath20.39
LiveCodeBenchcoding17.61
MT-Benchchat8.46

Variants (2)

variantkindquantbitsvRAMdlorgyear
Falcon-H1-1.5B-Baseoriginalbf1616.03,571tiiuae2025
Falcon-H1-1.5B-Instructoriginalbf1616.01,282tiiuae2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.