HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/Falcon-H1-7B-Base

tiiuae/Falcon-H1-7B-Base

family falcon · 4 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/Falcon-H1-7B-Base
best scores
BBH: 62.28TruthfulQA: 59.91HellaSwag: 81.26MMLU: 77.61GSM8K: 81.65MATH-500: 73.4GPQA: 36.58GPQA Diamond: 56.9MMLU-Pro: 51.75HumanEval: 86.59MBPP: 80.69LiveCodeBench: 35.03IFEval: 85.35AlpacaEval: 40.23MT-Bench: 8.85WinoGrande: 79.01MATH: 34.67

Best scores per benchmark

benchmarkcategorybest score
HumanEvalcoding86.59
IFEvalinstruction-following85.35
GSM8Kmath81.65
HellaSwagknowledge81.26
MBPPcoding80.69
WinoGrandeknowledge79.01
MMLUknowledge77.61
MATH-500math73.4
BBHreasoning62.28
TruthfulQAsafety59.91
GPQA Diamondreasoning56.9
MMLU-Proknowledge51.75
AlpacaEvalchat40.23
GPQAreasoning36.58
LiveCodeBenchcoding35.03
MATHmath34.67
MT-Benchchat8.85

Variants (4)

variantkindquantbitsvRAMdlorgyear
Falcon-H1-7B-Instructoriginalbf1616.011,606tiiuae2025
Falcon-H1R-7Boriginalbf1616.02,082tiiuae2026
Falcon-H1R-7B-GGUFggufgguf16.0820tiiuae2026
Falcon-H1-7B-Baseoriginalbf1616.0577tiiuae2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.