HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/Falcon-H1-0.5B-Base

tiiuae/Falcon-H1-0.5B-Base

family falcon · 3 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/Falcon-H1-0.5B-Base
best scores
BBH: 42.91MMLU: 57.12HellaSwag: 56.3WinoGrande: 59.43GSM8K: 68.39MATH: 15.18GPQA: 29.95MMLU-Pro: 31.03HumanEval: 51.83MBPP: 52.12TruthfulQA: 44.12MATH-500: 58.4GPQA Diamond: 27.95LiveCodeBench: 7.05IFEval: 72.07AlpacaEval: 10.79MT-Bench: 7.06

Best scores per benchmark

benchmarkcategorybest score
IFEvalinstruction-following72.07
GSM8Kmath68.39
WinoGrandeknowledge59.43
MATH-500math58.4
MMLUknowledge57.12
HellaSwagknowledge56.3
MBPPcoding52.12
HumanEvalcoding51.83
TruthfulQAsafety44.12
BBHreasoning42.91
MMLU-Proknowledge31.03
GPQAreasoning29.95
GPQA Diamondreasoning27.95
MATHmath15.18
AlpacaEvalchat10.79
MT-Benchchat7.06
LiveCodeBenchcoding7.05

Variants (3)

variantkindquantbitsvRAMdlorgyear
Falcon-H1-0.5B-Baseoriginalbf1616.0139,056tiiuae2025
Falcon-H1-0.5B-Instructoriginalbf1616.028,510tiiuae2025
Falcon-H1-0.5B-Instruct-GGUFggufgguf16.0792tiiuae2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.