HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/Falcon-H1-34B-Base

tiiuae/Falcon-H1-34B-Base

family falcon · 2 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/Falcon-H1-34B-Base
best scores
BBH: 70.68TruthfulQA: 65.27HellaSwag: 85.68MMLU: 84.05GSM8K: 83.62MATH-500: 83.8GPQA: 42.7GPQA Diamond: 49.66MMLU-Pro: 58.73HumanEval: 87.2MBPP: 83.86LiveCodeBench: 49.71IFEval: 89.37AlpacaEval: 48.32MT-Bench: 9.2WinoGrande: 82.72MATH: 40.71

Best scores per benchmark

benchmarkcategorybest score
IFEvalinstruction-following89.37
HumanEvalcoding87.2
HellaSwagknowledge85.68
MMLUknowledge84.05
MBPPcoding83.86
MATH-500math83.8
GSM8Kmath83.62
WinoGrandeknowledge82.72
BBHreasoning70.68
TruthfulQAsafety65.27
MMLU-Proknowledge58.73
LiveCodeBenchcoding49.71
GPQA Diamondreasoning49.66
AlpacaEvalchat48.32
GPQAreasoning42.7
MATHmath40.71
MT-Benchchat9.2

Variants (2)

variantkindquantbitsvRAMdlorgyear
Falcon-H1-34B-Instructoriginalbf1616.01,726tiiuae2025
Falcon-H1-34B-Baseoriginalbf1616.01,182tiiuae2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.