HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/Falcon-H1-34B-Instruct

tiiuae/Falcon-H1-34B-Instruct

family falcon · 3 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/Falcon-H1-34B-Instruct
best scores
BBH: 70.68TruthfulQA: 65.27HellaSwag: 81.94MMLU: 84.05GSM8K: 83.62MATH-500: 83.8GPQA: 41.53GPQA Diamond: 49.66MMLU-Pro: 58.73HumanEval: 87.2MBPP: 83.86LiveCodeBench: 49.71IFEval: 89.37AlpacaEval: 48.32MT-Bench: 9.2

Best scores per benchmark

benchmarkcategorybest score
IFEvalinstruction-following89.37
HumanEvalcoding87.2
MMLUknowledge84.05
MBPPcoding83.86
MATH-500math83.8
GSM8Kmath83.62
HellaSwagknowledge81.94
BBHreasoning70.68
TruthfulQAsafety65.27
MMLU-Proknowledge58.73
LiveCodeBenchcoding49.71
GPQA Diamondreasoning49.66
AlpacaEvalchat48.32
GPQAreasoning41.53
MT-Benchchat9.2

Variants (3)

variantkindquantbitsvRAMdlorgyear
Falcon-H1-34B-Instruct-GGUFggufgguf16.0924tiiuae2025
Falcon-H1-34B-Instruct-GGUFggufgguf16.0301unsloth2025
Falcon-H1-34B-Instruct-GPTQ-Int4gptqgptq50tiiuae2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.