tiiuae/Falcon-H1-7B-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HumanEval | coding | 86.59 | HumanEval | medium | | HumanEval | **86.59** | 84.75 | 82.32 | 84.76 | 68.29 | 71.95 | 82.32 | |
| IFEval | instruction-following | 85.35 | IFEval | medium | | IFEval | **85.35** | 83.43 | 75.25 | 81.51 | 77.04 | 76.59 | 78.84 | |
| GSM8K | math | 81.65 | GSM8k | medium | | GSM8k | 81.65 | 78.92 | 71.95 | **87.49** | 82.49 | 81.05 | 85.06 | |
| HumanEval | coding | 81.1 | HumanEval+ | medium | | HumanEval+ | **81.1** | 79.27 | 73.78 | 75.61 | 61.59 | 65.85 | 75.0 | |
| MBPP | coding | 80.69 | MBPP | medium | | MBPP | 80.69 | 71.96 | 79.63 | **85.71** | 68.25 | 77.25 | 73.28 | |
| MMLU | knowledge | 77.61 | MMLU-stem | medium | | MMLU-stem | **77.61** | 66.89 | 69.36 | 66.54 | 59.31 | 67.43 | 70.57 | |
| MMLU | knowledge | 76.83 | MMLU | medium | | MMLU | **76.83** | 71.56 | 73.64 | 72.5 | 68.67 | 70.81 | 74.01 | |
| HellaSwag | knowledge | 75.92 | HellaSwag | medium | | HellaSwag | **75.92** | 60.56 | 63.4 | 55.63 | 71.28 | 71.81 | 75.57 | |
| MATH-500 | math | 73.4 | MATH-500 | medium | | MATH-500 | 73.4 | 83.8 | 75.8 | **86.2** | 45.8 | 69.0 | 68.6 | |
| MBPP | coding | 68.78 | MBPP+ | medium | | MBPP+ | 68.78 | 62.7 | 68.25 | **72.22** | 55.03 | 65.87 | 64.02 | |
| BBH | reasoning | 62.28 | BBH | medium | | BBH | 62.28 | 47.47 | 53.76 | **63.36** | 48.58 | 52.12 | 58.09 | |
| TruthfulQA | safety | 59.91 | TruthfulQA | medium | | TruthfulQA | 59.91 | 53.19 | **62.41** | 61.02 | 52.99 | 55.58 | 55.05 | |
| GPQA Diamond | reasoning | 56.9 | GPQA_Diamond | medium | | GPQA_Diamond | **56.9** | 43.1 | 33.0 | 37.71 | 31.31 | 37.21 | 34.68 | |
| MMLU-Pro | knowledge | 51.75 | MMLU-Pro | medium | | MMLU-Pro | **51.75** | 34.64 | 43.23 | 39.88 | 36.42 | 40.73 | 44.05 | |
| AlpacaEval | chat | 40.23 | Alpaca-Eval | medium | | Alpaca-Eval | 40.23 | **46.13** | 29.48 | 43.55 | 25.48 | 27.56 | 24.31 | |
| GPQA | reasoning | 36.33 | GPQA | medium | | GPQA | **36.33** | 25.84 | 31.79 | 33.98 | 32.72 | 31.21 | 33.39 | |
| LiveCodeBench | coding | 35.03 | LiveCodeBench | medium | | LiveCodeBench | 35.03 | **45.6** | 32.68 | 30.92 | 15.85 | 12.72 | 19.77 | |
| MT-Bench | chat | 8.85 | MTBench | medium | | MTBench | **8.85** | 8.74 | 8.45 | 8.69 | 8.29 | 8.73 | 8.46 | |
none scraped.