tiiuae/Falcon-H1-3B-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| IFEval | instruction-following | 85.05 | IFEval | medium | | IFEval | **85.05** | 84.01 | 64.26 | 77.01 | 74.0 | 69.1 | |
| GSM8K | math | 84.76 | GSM8k | medium | | GSM8k | **84.76** | 80.44 | 57.54 | 77.41 | 77.26 | 74.68 | |
| MBPP | coding | 79.63 | MBPP | medium | | MBPP | **79.63** | 68.78 | 72.75 | 77.78 | 62.17 | 61.9 | |
| HumanEval | coding | 76.83 | HumanEval | medium | | HumanEval | 76.83 | **84.15** | 73.78 | 67.07 | 54.27 | 52.44 | |
| MATH-500 | math | 74.2 | MATH-500 | medium | | MATH-500 | 74.2 | **85.0** | 64.2 | 76.4 | 41.2 | 54.2 | |
| HumanEval | coding | 70.73 | HumanEval+ | medium | | HumanEval+ | 70.73 | **76.83** | 68.29 | 61.59 | 50.0 | 45.73 | |
| MMLU | knowledge | 69.93 | MMLU-stem | medium | | MMLU-stem | **69.93** | 67.46 | 59.78 | 52.17 | 51.92 | 56.11 | |
| HellaSwag | knowledge | 69.85 | HellaSwag | medium | | HellaSwag | **69.85** | 55.31 | 64.21 | 47.68 | 63.74 | 64.24 | |
| MMLU | knowledge | 68.3 | MMLU | medium | | MMLU | **68.3** | 67.01 | 65.09 | 59.53 | 61.74 | 56.76 | |
| MBPP | coding | 67.46 | MBPP+ | medium | | MBPP+ | **67.46** | 59.79 | 60.85 | 66.93 | 50.53 | 55.29 | |
| BBH | reasoning | 53.69 | BBH | medium | | BBH | **53.69** | 51.07 | 46.55 | 50.01 | 41.47 | 45.02 | |
| TruthfulQA | safety | 53.19 | TruthfulQA | medium | | TruthfulQA | 53.19 | 51.75 | **58.11** | 51.68 | 50.27 | 50.06 | |
| MMLU-Pro | knowledge | 43.69 | MMLU-Pro | medium | | MMLU-Pro | **43.69** | 29.75 | 32.76 | 29.71 | 27.44 | 29.71 | |
| GPQA Diamond | reasoning | 38.72 | GPQA_Diamond | medium | | GPQA_Diamond | 38.72 | **40.74** | 35.69 | 28.62 | 29.97 | 29.29 | |
| GPQA | reasoning | 33.89 | GPQA | medium | | GPQA | **33.89** | 28.02 | 28.69 | 29.19 | 28.94 | 28.69 | |
| AlpacaEval | chat | 31.09 | Alpaca-Eval | medium | | Alpaca-Eval | 31.09 | 36.51 | 17.37 | **39.64** | 19.69 | 14.82 | |
| LiveCodeBench | coding | 26.81 | LiveCodeBench | medium | | LiveCodeBench | 26.81 | **39.92** | 11.74 | 21.14 | 2.74 | 3.13 | |
| MT-Bench | chat | 8.72 | MTBench | medium | | MTBench | **8.72** | 8.45 | 7.79 | 8.24 | 7.96 | 7.79 | |
none scraped.