tiiuae/Falcon-H1-3B-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HellaSwag | knowledge | 73.85 | HellaSwag | medium | | HellaSwag | 73.85 | 75.74 | 74.6 | **77.62** | 76.39 | 67.13 | |
| MBPP | coding | 71.43 | MBPP | medium | | MBPP | 71.43 | **74.6** | 59.52 | 60.05 | 48.94 | 51.85 | |
| MMLU | knowledge | 69.55 | MMLU-stem | medium | | MMLU-stem | 69.55 | **75.58** | 62.23 | 51.7 | 47.67 | 55.34 | |
| MMLU | knowledge | 68.39 | MMLU | medium | | MMLU | 68.39 | **72.92** | 65.56 | 59.41 | 55.94 | 56.77 | |
| GSM8K | math | 68.31 | GSM8k | medium | | GSM8k | 68.31 | **81.65** | 74.6 | 37.6 | 27.82 | 64.67 | |
| WinoGrande | knowledge | 68.11 | Winogrande | medium | | Winogrande | 68.11 | 72.3 | 71.03 | **72.77** | 72.22 | 65.11 | |
| HumanEval | coding | 59.15 | HumanEval | medium | | HumanEval | 59.15 | **74.39** | 42.68 | 33.54 | 29.27 | 36.59 | |
| MBPP | coding | 57.94 | MBPP+ | medium | | MBPP+ | 57.94 | **63.76** | 50.53 | 51.32 | 39.42 | 42.06 | |
| HumanEval | coding | 53.66 | HumanEval+ | medium | | HumanEval+ | 53.66 | **68.9** | 35.37 | 28.05 | 26.22 | 31.71 | |
| BBH | reasoning | 53.17 | BBH | medium | | BBH | 53.17 | **56.88** | 46.4 | 40.41 | 39.45 | 44.02 | |
| MMLU-Pro | knowledge | 40.58 | MMLU-Pro | medium | | MMLU-Pro | 40.58 | **46.18** | 32.12 | 28.34 | 25.08 | 29.03 | |
| GPQA | reasoning | 32.63 | GPQA | medium | | GPQA | 32.63 | **34.9** | 28.44 | 29.78 | 28.78 | 29.78 | |
| MATH | math | 25.83 | MATH lvl5 | medium | | MATH lvl5 | **25.83** | 24.47 | 16.09 | 6.95 | 1.74 | 11.56 | |
none scraped.