unsloth/Falcon-H1-34B-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| IFEval | instruction-following | 89.37 | IFEval | medium | | IFEval | 89.37 | 86.97 | 86.35 | 81.79 | 83.19 | **89.94** | 86.32 | |
| HumanEval | coding | 87.2 | HumanEval | medium | | HumanEval | 87.2 | **90.85** | 87.2 | 90.24 | 86.59 | 83.53 | 85.4 | |
| MMLU | knowledge | 84.05 | MMLU | medium | | MMLU | 84.05 | 80.89 | **84.42** | 82.8 | 78.01 | 82.08 | 80.4 | |
| MBPP | coding | 83.86 | MBPP | medium | | MBPP | 83.86 | 86.24 | **89.68** | 87.83 | 88.36 | 88.09 | 81.5 | |
| MATH-500 | math | 83.8 | MATH-500 | medium | | MATH-500 | 83.8 | 82.0 | 83.6 | 82.2 | **90.0** | 70.6 | 83.2 | |
| GSM8K | math | 83.62 | GSM8k | medium | | GSM8k | 83.62 | 88.78 | 82.26 | 78.47 | 90.37 | **93.71** | 90.37 | |
| MMLU | knowledge | 83.57 | MMLU-stem | medium | | MMLU-stem | **83.57** | 81.64 | 82.59 | 82.37 | 73.55 | 74.88 | 75.2 | |
| HellaSwag | knowledge | 81.94 | HellaSwag | medium | | HellaSwag | **81.94** | 68.89 | 68.79 | 73.95 | 57.25 | 70.24 | 65.03 | |
| HumanEval | coding | 81.71 | HumanEval+ | medium | | HumanEval+ | 81.71 | **85.37** | 80.49 | 82.32 | 78.05 | 79.87 | 78.7 | |
| MBPP | coding | 71.43 | MBPP+ | medium | | MBPP+ | 71.43 | 71.96 | **75.4** | 74.07 | 74.07 | 73.81 | 64.8 | |
| BBH | reasoning | 70.68 | BBH | medium | | BBH | 70.68 | 62.47 | **72.52** | 68.72 | 67.28 | 69.15 | 64.9 | |
| TruthfulQA | safety | 65.27 | TruthfulQA | medium | | TruthfulQA | 65.27 | 58.58 | 69.8 | **70.28** | 64.26 | 66.15 | 62.74 | |
| MMLU-Pro | knowledge | 58.73 | MMLU-Pro | medium | | MMLU-Pro | **58.73** | 54.68 | 56.35 | 56.63 | 47.81 | 53.29 | 55.58 | |
| LiveCodeBench | coding | 49.71 | LiveCodeBench | medium | | LiveCodeBench | 49.71 | 45.01 | **54.6** | 49.12 | 39.53 | 40.31 | 40.12 | |
| GPQA Diamond | reasoning | 49.66 | GPQA_Diamond | medium | | GPQA_Diamond | 49.66 | 49.49 | 44.95 | 40.74 | 47.47 | 42.09 | **51.18** | |
| AlpacaEval | chat | 48.32 | Alpaca-Eval | medium | | Alpaca-Eval | 48.32 | **64.21** | 49.29 | 39.26 | 56.16 | 38.27 | 36.26 | |
| GPQA | reasoning | 41.53 | GPQA | medium | | GPQA | **41.53** | 30.2 | 37.67 | 34.31 | 36.49 | 31.99 | 31.8 | |
| MT-Bench | chat | 9.2 | MTBench | medium | | MTBench | **9.2** | 9.05 | 9.16 | 9.09 | 8.75 | 8.98 | 8.98 | |
none scraped.