falcon-mamba-7b

Home/Models/tiiuae/falcon-mamba-7b

falcon-mamba-7b

tiiuae/falcon-mamba-7b

kind: original
quant: bf16 (16-bit)
family: falcon
modality: text-generation
root model: tiiuae/falcon-mamba-7b
provider: tiiuae
license: other
language: en
context: 2,048
library: —
vRAM (GB): —
size on disk: —
downloads: 174,155
likes: 244
created: —
last modified: 2024-12-17T11:10:58+00:00 (2024)
huggingface: https://huggingface.co/tiiuae/falcon-mamba-7b
tags: transformerssafetensorsfalcon_mambatext-generationendataset:tiiuae/falcon-refinedwebdataset:HuggingFaceFW/fineweb-eduarxiv:2312.00752arxiv:2410.05355license:othermodel-indexendpoints_compatibleregion:us

Benchmark scores (17)

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	80.82		low	\| `FalconMamba-7B`<sup></sup> \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09* \|
WinoGrande	knowledge	73.64		low	\| `FalconMamba-7B`<sup></sup> \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09* \|
MMLU	knowledge	62.11		low	\| `FalconMamba-7B`<sup></sup> \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09* \|
TruthfulQA	safety	53.42		low	\| `FalconMamba-7B`<sup></sup> \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09* \|
GSM8K	math	52.54		low	\| `FalconMamba-7B`<sup></sup> \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09* \|
IFEval	instruction-following	33.36		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
IFEval	instruction-following	33.36	IFEval (0-Shot)	medium	`\| IFEval (0-Shot) \| 33.36 \|`
BBH	reasoning	19.88		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
BBH	reasoning	19.88	BBH (3-Shot)	medium	`\| BBH (3-Shot) \| 19.88 \|`
MMLU-Pro	knowledge	14.47		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MMLU-Pro	knowledge	14.47	MMLU-PRO (5-shot)	medium	`\| MMLU-PRO (5-shot) \| 14.47 \|`
MUSR	reasoning	10.86		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MUSR	reasoning	10.86	MuSR (0-shot)	medium	`\| MuSR (0-shot) \| 10.86 \|`
GPQA	reasoning	8.05		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
GPQA	reasoning	8.05	GPQA (0-shot)	medium	`\| GPQA (0-shot) \| 8.05 \|`
MATH	math	3.63		low	\| `FalconMamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MATH	math	3.63	MATH Lvl 5 (4-Shot)	medium	`\| MATH Lvl 5 (4-Shot) \| 3.63 \|`

Discussions (0)

none scraped.