HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/tiiuae/tiiuae/falcon-mamba-7b

tiiuae/falcon-mamba-7b

family falcon · 6 variants · unknown

provider
tiiuae
released
—
huggingface
https://huggingface.co/tiiuae/falcon-mamba-7b
best scores
IFEval: 33.36BBH: 19.88MATH: 3.63GPQA: 8.05MUSR: 10.86MMLU-Pro: 14.47HellaSwag: 80.82MMLU: 62.11WinoGrande: 73.64TruthfulQA: 53.42GSM8K: 52.54

Best scores per benchmark

benchmarkcategorybest score
HellaSwagknowledge80.82
WinoGrandeknowledge73.64
MMLUknowledge62.11
TruthfulQAsafety53.42
GSM8Kmath52.54
IFEvalinstruction-following33.36
BBHreasoning19.88
MMLU-Proknowledge14.47
MUSRreasoning10.86
GPQAreasoning8.05
MATHmath3.63

Variants (6)

variantkindquantbitsvRAMdlorgyear
falcon-mamba-7boriginalbf1616.0174,155tiiuae2024
falcon-mamba-7b-instructoriginalbf1616.017,209tiiuae2024
falcon-mamba-7b-GGUFggufgguf2.0872bartowski2024
falcon-mamba-7b-Q8_0-GGUFggufgguf8.079tiiuae2024
falcon-mamba-7b-F16-GGUFggufgguf16.064tiiuae2024
falcon-mamba-7b-4bitbnb-4bit4bit52tiiuae2024
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.