family falcon · 2 variants · unknown
| benchmark | category | best score |
|---|---|---|
| HellaSwag | knowledge | 80.82 |
| WinoGrande | knowledge | 73.64 |
| MMLU | knowledge | 62.11 |
| TruthfulQA | safety | 53.42 |
| GSM8K | math | 52.54 |
| IFEval | instruction-following | 33.36 |
| BBH | reasoning | 19.88 |
| MMLU-Pro | knowledge | 14.47 |
| MUSR | reasoning | 10.86 |
| GPQA | reasoning | 8.05 |
| MATH | math | 3.63 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| falcon-mamba-7b-instruct-Q4_K_M-GGUF | gguf | gguf | 4.0 | 3,285 | tiiuae | 2024 | |
| falcon-mamba-7b-instruct-4bit | bnb-4bit | 4bit | 159 | tiiuae | 2024 |