HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Falcon-H1-3B-Instruct

tiiuae/Falcon-H1-3B-Instruct

kind
original
quant
bf16 (16-bit)
family
falcon
modality
text-generation
root model
tiiuae/Falcon-H1-3B-Base
provider
tiiuae
license
other
language
ar, cs, de, en, es, fr, hi, it, ja, ko, nl, pl
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
2,976
likes
14
created
—
last modified
2025-07-31T03:59:30+00:00 (2025)
huggingface
https://huggingface.co/tiiuae/Falcon-H1-3B-Instruct
tags
transformerssafetensorsfalcon_h1text-generationfalcon-h1conversationalarcsdeenesfrhiitjakonlplptrorusvurzh

Benchmark scores (18)

benchmarkcategoryscorecontextconfevidence
IFEvalinstruction-following85.05IFEvalmedium| IFEval | **85.05** | 84.01 | 64.26 | 77.01 | 74.0 | 69.1 |
GSM8Kmath84.76GSM8kmedium| GSM8k | **84.76** | 80.44 | 57.54 | 77.41 | 77.26 | 74.68 |
MBPPcoding79.63MBPPmedium| MBPP | **79.63** | 68.78 | 72.75 | 77.78 | 62.17 | 61.9 |
HumanEvalcoding76.83HumanEvalmedium| HumanEval | 76.83 | **84.15** | 73.78 | 67.07 | 54.27 | 52.44 |
MATH-500math74.2MATH-500medium| MATH-500 | 74.2 | **85.0** | 64.2 | 76.4 | 41.2 | 54.2 |
HumanEvalcoding70.73HumanEval+medium| HumanEval+ | 70.73 | **76.83** | 68.29 | 61.59 | 50.0 | 45.73 |
MMLUknowledge69.93MMLU-stemmedium| MMLU-stem | **69.93** | 67.46 | 59.78 | 52.17 | 51.92 | 56.11 |
HellaSwagknowledge69.85HellaSwagmedium| HellaSwag | **69.85** | 55.31 | 64.21 | 47.68 | 63.74 | 64.24 |
MMLUknowledge68.3MMLUmedium| MMLU | **68.3** | 67.01 | 65.09 | 59.53 | 61.74 | 56.76 |
MBPPcoding67.46MBPP+medium| MBPP+ | **67.46** | 59.79 | 60.85 | 66.93 | 50.53 | 55.29 |
BBHreasoning53.69BBHmedium| BBH | **53.69** | 51.07 | 46.55 | 50.01 | 41.47 | 45.02 |
TruthfulQAsafety53.19TruthfulQAmedium| TruthfulQA | 53.19 | 51.75 | **58.11** | 51.68 | 50.27 | 50.06 |
MMLU-Proknowledge43.69MMLU-Promedium| MMLU-Pro | **43.69** | 29.75 | 32.76 | 29.71 | 27.44 | 29.71 |
GPQA Diamondreasoning38.72GPQA_Diamondmedium| GPQA_Diamond | 38.72 | **40.74** | 35.69 | 28.62 | 29.97 | 29.29 |
GPQAreasoning33.89GPQAmedium| GPQA | **33.89** | 28.02 | 28.69 | 29.19 | 28.94 | 28.69 |
AlpacaEvalchat31.09Alpaca-Evalmedium| Alpaca-Eval | 31.09 | 36.51 | 17.37 | **39.64** | 19.69 | 14.82 |
LiveCodeBenchcoding26.81LiveCodeBenchmedium| LiveCodeBench | 26.81 | **39.92** | 11.74 | 21.14 | 2.74 | 3.13 |
MT-Benchchat8.72MTBenchmedium| MTBench | **8.72** | 8.45 | 7.79 | 8.24 | 7.96 | 7.79 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.