tiiuae/Falcon-H1-1.5B-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HellaSwag | knowledge | 66.76 | HellaSwag | medium | | HellaSwag | 66.76 | 67.09 | **67.86** | 62.94 | 65.73 | 62.3 | |
| WinoGrande | knowledge | 65.59 | Winogrande | medium | | Winogrande | 65.59 | **66.3** | 64.56 | 62.59 | 62.75 | 61.17 | |
| MBPP | coding | 65.08 | MBPP | medium | | MBPP | 65.08 | **67.72** | 60.05 | 12.7 | 35.98 | 12.43 | |
| MMLU | knowledge | 63.37 | MMLU-stem | medium | | MMLU-stem | **63.37** | 61.53 | 54.93 | 27.59 | 30.19 | 40.06 | |
| MMLU | knowledge | 61.81 | MMLU | medium | | MMLU | 61.81 | **62.46** | 61.13 | 26.33 | 32.39 | 45.14 | |
| MBPP | coding | 55.03 | MBPP+ | medium | | MBPP+ | 55.03 | **58.99** | 49.47 | 9.52 | 29.89 | 9.52 | |
| GSM8K | math | 52.01 | GSM8k | medium | | GSM8k | 52.01 | **70.74** | 63.0 | 2.2 | 7.05 | 34.95 | |
| HumanEval | coding | 50.0 | HumanEval | medium | | HumanEval | 50.0 | **67.68** | 35.37 | 6.71 | 18.9 | 10.37 | |
| BBH | reasoning | 46.57 | BBH | medium | | BBH | **46.57** | 43.05 | 40.55 | 30.26 | 30.72 | 35.24 | |
| HumanEval | coding | 42.68 | HumanEval+ | medium | | HumanEval+ | 42.68 | **60.98** | 29.27 | 5.49 | 16.46 | 9.15 | |
| MMLU-Pro | knowledge | 35.53 | MMLU-Pro | medium | | MMLU-Pro | **35.53** | 33.81 | 28.72 | 11.31 | 11.8 | 16.11 | |
| GPQA | reasoning | 29.11 | GPQA | medium | | GPQA | 29.11 | **29.45** | 28.36 | 24.66 | 23.57 | 27.85 | |
| MATH | math | 20.39 | MATH lvl5 | medium | | MATH lvl5 | **20.39** | 16.39 | 8.84 | 1.21 | 0.98 | 3.4 | |
none scraped.