tiiuae/Falcon-H1-0.5B-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| GSM8K | math | 60.2 | GSM8k | medium | | GSM8k | **60.2** | 50.04 | 34.8 | 2.2 | 7.05 | 34.95 | |
| WinoGrande | knowledge | 59.43 | Winogrande | medium | | Winogrande | 59.43 | 60.54 | 56.83 | 62.59 | **62.75** | 61.17 | |
| MMLU | knowledge | 57.12 | MMLU-stem | medium | | MMLU-stem | **57.12** | 50.11 | 43.74 | 27.59 | 30.19 | 40.06 | |
| HellaSwag | knowledge | 56.3 | HellaSwag | medium | | HellaSwag | 56.3 | 53.51 | 51.79 | 62.94 | **65.73** | 62.3 | |
| MMLU | knowledge | 55.04 | MMLU | medium | | MMLU | **55.04** | 52.64 | 47.61 | 26.33 | 32.39 | 45.14 | |
| MBPP | coding | 52.12 | MBPP | medium | | MBPP | **52.12** | 51.06 | 40.74 | 12.7 | 35.98 | 12.43 | |
| MBPP | coding | 43.39 | MBPP+ | medium | | MBPP+ | **43.39** | 42.33 | 34.66 | 9.52 | 29.89 | 9.52 | |
| BBH | reasoning | 40.22 | BBH | medium | | BBH | **40.22** | 36.07 | 32.62 | 30.26 | 30.72 | 35.24 | |
| HumanEval | coding | 35.98 | HumanEval | medium | | HumanEval | **35.98** | 31.71 | 29.27 | 6.71 | 18.9 | 10.37 | |
| HumanEval | coding | 31.1 | HumanEval+ | medium | | HumanEval+ | **31.1** | 27.44 | 25.0 | 5.49 | 16.46 | 9.15 | |
| MMLU-Pro | knowledge | 30.04 | MMLU-Pro | medium | | MMLU-Pro | **30.04** | 22.99 | 18.98 | 11.31 | 11.8 | 16.11 | |
| GPQA | reasoning | 29.7 | GPQA | medium | | GPQA | **29.7** | 29.11 | 27.94 | 24.66 | 23.57 | 27.85 | |
| MATH | math | 15.18 | MATH lvl5 | medium | | MATH lvl5 | **15.18** | 9.29 | 4.23 | 1.21 | 0.98 | 3.4 | |
none scraped.