tiiuae/Falcon-H1-1.5B-Deep-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MBPP | coding | 70.9 | MBPP | medium | | MBPP | **70.9** | 67.72 | 60.05 | 12.7 | 35.98 | 12.43 | |
| HellaSwag | knowledge | 69.72 | HellaSwag | medium | | HellaSwag | **69.72** | 67.09 | 67.86 | 62.94 | 65.73 | 62.3 | |
| GSM8K | math | 68.69 | GSM8k | medium | | GSM8k | 68.69 | **70.74** | 63.0 | 2.2 | 7.05 | 34.95 | |
| MMLU | knowledge | 67.43 | MMLU-stem | medium | | MMLU-stem | **67.43** | 61.53 | 54.93 | 27.59 | 30.19 | 40.06 | |
| WinoGrande | knowledge | 67.09 | Winogrande | medium | | Winogrande | **67.09** | 66.3 | 64.56 | 62.59 | 62.75 | 61.17 | |
| MMLU | knowledge | 66.29 | MMLU | medium | | MMLU | **66.29** | 62.46 | 61.13 | 26.33 | 32.39 | 45.14 | |
| MBPP | coding | 60.32 | MBPP+ | medium | | MBPP+ | **60.32** | 58.99 | 49.47 | 9.52 | 29.89 | 9.52 | |
| HumanEval | coding | 52.44 | HumanEval | medium | | HumanEval | 52.44 | **67.68** | 35.37 | 6.71 | 18.9 | 10.37 | |
| BBH | reasoning | 52.37 | BBH | medium | | BBH | **52.37** | 43.05 | 40.55 | 30.26 | 30.72 | 35.24 | |
| HumanEval | coding | 46.34 | HumanEval+ | medium | | HumanEval+ | 46.34 | **60.98** | 29.27 | 5.49 | 16.46 | 9.15 | |
| MMLU-Pro | knowledge | 41.07 | MMLU-Pro | medium | | MMLU-Pro | **41.07** | 33.81 | 28.72 | 11.31 | 11.8 | 16.11 | |
| GPQA | reasoning | 32.8 | GPQA | medium | | GPQA | **32.8** | 29.45 | 28.36 | 24.66 | 23.57 | 27.85 | |
| MATH | math | 24.77 | MATH lvl5 | medium | | MATH lvl5 | **24.77** | 16.39 | 8.84 | 1.21 | 0.98 | 3.4 | |
none scraped.