HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Falcon-H1-34B-Instruct-GGUF

tiiuae/Falcon-H1-34B-Instruct-GGUF

kind
gguf
quant
gguf (16-bit)
family
falcon
modality
text-generation
root model
tiiuae/Falcon-H1-34B-Instruct
provider
tiiuae
license
other
language
ar, cs, de, en, es, fr, hi, it, ja, ko, nl, pl
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
924
likes
17
created
—
last modified
2025-08-04T07:05:38+00:00 (2025)
huggingface
https://huggingface.co/tiiuae/Falcon-H1-34B-Instruct-GGUF
tags
transformersgguffalcon-h1text-generationarcsdeenesfrhiitjakonlplptrorusvurzharxiv:2507.22448base_model:tiiuae/Falcon-H1-34B-Instruct

Benchmark scores (18)

benchmarkcategoryscorecontextconfevidence
IFEvalinstruction-following89.37IFEvalmedium| IFEval | 89.37 | 86.97 | 86.35 | 81.79 | 83.19 | **89.94** | 86.32 |
HumanEvalcoding87.2HumanEvalmedium| HumanEval | 87.2 | **90.85** | 87.2 | 90.24 | 86.59 | 83.53 | 85.4 |
MMLUknowledge84.05MMLUmedium| MMLU | 84.05 | 80.89 | **84.42** | 82.8 | 78.01 | 82.08 | 80.4 |
MBPPcoding83.86MBPPmedium| MBPP | 83.86 | 86.24 | **89.68** | 87.83 | 88.36 | 88.09 | 81.5 |
MATH-500math83.8MATH-500medium| MATH-500 | 83.8 | 82.0 | 83.6 | 82.2 | **90.0** | 70.6 | 83.2 |
GSM8Kmath83.62GSM8kmedium| GSM8k | 83.62 | 88.78 | 82.26 | 78.47 | 90.37 | **93.71** | 90.37 |
MMLUknowledge83.57MMLU-stemmedium| MMLU-stem | **83.57** | 81.64 | 82.59 | 82.37 | 73.55 | 74.88 | 75.2 |
HellaSwagknowledge81.94HellaSwagmedium| HellaSwag | **81.94** | 68.89 | 68.79 | 73.95 | 57.25 | 70.24 | 65.03 |
HumanEvalcoding81.71HumanEval+medium| HumanEval+ | 81.71 | **85.37** | 80.49 | 82.32 | 78.05 | 79.87 | 78.7 |
MBPPcoding71.43MBPP+medium| MBPP+ | 71.43 | 71.96 | **75.4** | 74.07 | 74.07 | 73.81 | 64.8 |
BBHreasoning70.68BBHmedium| BBH | 70.68 | 62.47 | **72.52** | 68.72 | 67.28 | 69.15 | 64.9 |
TruthfulQAsafety65.27TruthfulQAmedium| TruthfulQA | 65.27 | 58.58 | 69.8 | **70.28** | 64.26 | 66.15 | 62.74 |
MMLU-Proknowledge58.73MMLU-Promedium| MMLU-Pro | **58.73** | 54.68 | 56.35 | 56.63 | 47.81 | 53.29 | 55.58 |
LiveCodeBenchcoding49.71LiveCodeBenchmedium| LiveCodeBench | 49.71 | 45.01 | **54.6** | 49.12 | 39.53 | 40.31 | 40.12 |
GPQA Diamondreasoning49.66GPQA_Diamondmedium| GPQA_Diamond | 49.66 | 49.49 | 44.95 | 40.74 | 47.47 | 42.09 | **51.18** |
AlpacaEvalchat48.32Alpaca-Evalmedium| Alpaca-Eval | 48.32 | **64.21** | 49.29 | 39.26 | 56.16 | 38.27 | 36.26 |
GPQAreasoning41.53GPQAmedium| GPQA | **41.53** | 30.2 | 37.67 | 34.31 | 36.49 | 31.99 | 31.8 |
MT-Benchchat9.2MTBenchmedium| MTBench | **9.2** | 9.05 | 9.16 | 9.09 | 8.75 | 8.98 | 8.98 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.