unsloth/Falcon-H1-0.5B-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| IFEval | instruction-following | 72.07 | IFEval | medium | | IFEval | **72.07** | 62.16 | 32.11 | 61.48 | 55.34 | 54.26 | |
| GSM8K | math | 68.39 | GSM8k | medium | | GSM8k | **68.39** | 42.61 | 38.51 | 42.38 | 44.28 | 44.05 | |
| MATH-500 | math | 58.4 | MATH-500 | medium | | MATH-500 | **58.4** | 46.0 | 27.8 | 45.4 | 13.2 | 19.8 | |
| MMLU | knowledge | 54.55 | MMLU-stem | medium | | MMLU-stem | **54.55** | 39.3 | 39.83 | 35.39 | 39.16 | 39.64 | |
| MMLU | knowledge | 53.4 | MMLU | medium | | MMLU | **53.4** | 42.98 | 46.07 | 40.87 | 45.93 | 46.1 | |
| HellaSwag | knowledge | 51.93 | HellaSwag | medium | | HellaSwag | 51.93 | 42.17 | 52.38 | 42.24 | 55.3 | **58.53** | |
| HumanEval | coding | 51.83 | HumanEval | medium | | HumanEval | **51.83** | 41.46 | 36.59 | 40.85 | 34.15 | 22.56 | |
| HumanEval | coding | 45.12 | HumanEval+ | medium | | HumanEval+ | **45.12** | 37.19 | 32.32 | 37.2 | 29.88 | 20.73 | |
| TruthfulQA | safety | 44.12 | TruthfulQA | medium | | TruthfulQA | 44.12 | **51.65** | 46.19 | 42.17 | 42.08 | 42.31 | |
| BBH | reasoning | 42.91 | BBH | medium | | BBH | **42.91** | 32.95 | 33.26 | 35.86 | 33.21 | 34.47 | |
| MBPP | coding | 42.59 | MBPP | medium | | MBPP | 42.59 | 56.08 | 46.83 | **57.67** | 33.6 | 20.63 | |
| MBPP | coding | 33.07 | MBPP+ | medium | | MBPP+ | 33.07 | 47.08 | 39.68 | **50.0** | 29.37 | 17.2 | |
| MMLU-Pro | knowledge | 31.03 | MMLU-Pro | medium | | MMLU-Pro | **31.03** | 16.95 | 18.73 | 14.46 | 16.2 | 18.49 | |
| GPQA | reasoning | 29.95 | GPQA | medium | | GPQA | **29.95** | 26.09 | 26.85 | 28.19 | 26.59 | 26.76 | |
| GPQA Diamond | reasoning | 27.95 | GPQA_Diamond | medium | | GPQA_Diamond | 27.95 | 25.08 | 24.24 | 21.55 | 25.08 | **31.31** | |
| AlpacaEval | chat | 10.79 | Alpaca-Eval | medium | | Alpaca-Eval | 10.79 | 9.59 | 3.26 | **17.87** | 9.38 | 6.98 | |
| MT-Bench | chat | 7.06 | MTBench | medium | | MTBench | **7.06** | 5.75 | 4.71 | 7.03 | 6.37 | 6.03 | |
| LiveCodeBench | coding | 7.05 | LiveCodeBench | medium | | LiveCodeBench | 7.05 | **9.78** | 2.94 | 5.09 | 2.35 | 0.78 | |
none scraped.