Falcon-H1-1.5B-Instruct-GPTQ-Int8

Home/Models/tiiuae/Falcon-H1-1.5B-Instruct-GPTQ-Int8

Falcon-H1-1.5B-Instruct-GPTQ-Int8

tiiuae/Falcon-H1-1.5B-Instruct-GPTQ-Int8

kind: gptq
quant: gptq
family: falcon
modality: text-generation
root model: tiiuae/Falcon-H1-1.5B-Instruct
provider: tiiuae
license: other
language: —
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 60
likes: 0
created: —
last modified: 2025-05-21T08:06:26+00:00 (2025)
huggingface: https://huggingface.co/tiiuae/Falcon-H1-1.5B-Instruct-GPTQ-Int8
tags: transformerssafetensorsfalcon_h1text-generationfalcon-h1conversationalbase_model:tiiuae/Falcon-H1-1.5B-Instructbase_model:quantized:tiiuae/Falcon-H1-1.5B-Instructlicense:otherendpoints_compatible8-bitgptqregion:us

Benchmark scores (18)

benchmark	category	score	context	conf	evidence
IFEval	instruction-following	80.66	IFEval	medium	`\| IFEval \| 80.66 \| 70.77 \| 45.33 \| 61.48 \| 55.34 \| 54.26 \|`
GSM8K	math	74.98	GSM8k	medium	`\| GSM8k \| 74.98 \| 69.83 \| 57.47 \| 42.38 \| 44.28 \| 44.05 \|`
MATH-500	math	74.0	MATH-500	medium	`\| MATH-500 \| 74.0 \| 73.0 \| 48.4 \| 45.4 \| 13.2 \| 19.8 \|`
HumanEval	coding	68.29	HumanEval	medium	`\| HumanEval \| 68.29 \| 67.68 \| 56.1 \| 40.85 \| 34.15 \| 22.56 \|`
MBPP	coding	64.81	MBPP	medium	`\| MBPP \| 64.81 \| 58.73 \| 64.81 \| 57.67 \| 33.6 \| 20.63 \|`
MMLU	knowledge	64.13	MMLU-stem	medium	`\| MMLU-stem \| 64.13 \| 54.3 \| 54.04 \| 35.39 \| 39.16 \| 39.64 \|`
HellaSwag	knowledge	63.33	HellaSwag	medium	`\| HellaSwag \| 63.33 \| 49.27 \| 62.23 \| 42.24 \| 55.3 \| 58.53 \|`
MMLU	knowledge	62.03	MMLU	medium	`\| MMLU \| 62.03 \| 57.04 \| 59.76 \| 40.87 \| 45.93 \| 46.1 \|`
HumanEval	coding	61.59	HumanEval+	medium	`\| HumanEval+ \| 61.59 \| 60.96 \| 50.61 \| 37.2 \| 29.88 \| 20.73 \|`
MBPP	coding	56.35	MBPP+	medium	`\| MBPP+ \| 56.35 \| 49.74 \| 56.08 \| 50.0 \| 29.37 \| 17.2 \|`
BBH	reasoning	46.47	BBH	medium	`\| BBH \| 46.47 \| 35.18 \| 42.41 \| 35.86 \| 33.21 \| 34.47 \|`
TruthfulQA	safety	45.98	TruthfulQA	medium	`\| TruthfulQA \| 45.98 \| 49.39 \| 47.05 \| 42.17 \| 42.08 \| 42.31 \|`
MMLU-Pro	knowledge	37.8	MMLU-Pro	medium	`\| MMLU-Pro \| 37.8 \| 23.54 \| 28.35 \| 14.46 \| 16.2 \| 18.49 \|`
GPQA Diamond	reasoning	35.19	GPQA_Diamond	medium	`\| GPQA_Diamond \| 35.19 \| 33.33 \| 25.59 \| 21.55 \| 25.08 \| 31.31 \|`
AlpacaEval	chat	28.18	Alpaca-Eval	medium	`\| Alpaca-Eval \| 28.18 \| 21.89 \| 9.54 \| 17.87 \| 9.38 \| 6.98 \|`
GPQA	reasoning	26.34	GPQA	medium	`\| GPQA \| 26.34 \| 27.68 \| 26.26 \| 28.19 \| 26.59 \| 26.76 \|`
LiveCodeBench	coding	17.61	LiveCodeBench	medium	`\| LiveCodeBench \| 17.61 \| 14.87 \| 12.52 \| 5.09 \| 2.35 \| 0.78 \|`
MT-Bench	chat	8.46	MTBench	medium	`\| MTBench \| 8.46 \| 7.61 \| 7.1 \| 7.03 \| 6.37 \| 6.03 \|`

Discussions (0)

none scraped.