falcon-mamba-7b-4bit

Home/Models/tiiuae/falcon-mamba-7b-4bit

tiiuae/falcon-mamba-7b-4bit

kind: bnb-4bit
quant: 4bit
family: falcon
modality: text-generation
root model: tiiuae/falcon-mamba-7b
provider: tiiuae
license: - other
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 52
likes: 11
created: —
last modified: 2024-10-10T06:07:05+00:00 (2024)
huggingface: https://huggingface.co/tiiuae/falcon-mamba-7b-4bit
tags: transformerssafetensorsfalcon_mambatext-generationendataset:tiiuae/falcon-refinedwebdataset:HuggingFaceFW/fineweb-eduarxiv:2312.00752arxiv:2410.05355base_model:tiiuae/falcon-mamba-7bbase_model:quantized:tiiuae/falcon-mamba-7blicense:otherendpoints_compatible4-bitbitsandbytesregion:us

benchmark	category	score	conf	evidence
HellaSwag	knowledge	80.82	low	\| `Falcon-Mamba-7B` \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09 \|
WinoGrande	knowledge	73.64	low	\| `Falcon-Mamba-7B` \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09 \|
MMLU	knowledge	62.11	low	\| `Falcon-Mamba-7B` \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09 \|
TruthfulQA	safety	53.42	low	\| `Falcon-Mamba-7B` \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09 \|
GSM8K	math	52.54	low	\| `Falcon-Mamba-7B` \| 62.03 \| 80.82 \| 62.11 \| 73.64 \| 53.42 \| 52.54 \| 64.09 \|
IFEval	instruction-following	33.36	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
BBH	reasoning	19.88	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MMLU-Pro	knowledge	14.47	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MUSR	reasoning	10.86	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
GPQA	reasoning	8.05	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|
MATH	math	3.63	low	\| `Falcon-Mamba-7B` \| 33.36 \| 19.88 \| 3.63 \| 8.05 \| 10.86 \| 14.47 \| 15.04 \|

none scraped.