tiiuae/Falcon-H1-7B-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HellaSwag | knowledge | 81.26 | HellaSwag | medium | | HellaSwag | 81.26 | 79.6 | 80.2 | **84.22** | 81.97 | 76.69 | 79.64 | |
| WinoGrande | knowledge | 79.01 | Winogrande | medium | | Winogrande | 79.01 | 76.8 | 76.01 | **79.79** | 77.11 | 73.64 | 79.01 | |
| MBPP | coding | 78.57 | MBPP | medium | | MBPP | **78.57** | 75.13 | 76.72 | 73.02 | 61.38 | 67.99 | 73.54 | |
| MMLU | knowledge | 77.38 | MMLU | medium | | MMLU | **77.38** | 76.63 | 74.17 | 74.23 | 65.17 | 69.98 | 73.22 | |
| MMLU | knowledge | 77.2 | MMLU-stem | medium | | MMLU-stem | 77.2 | **78.53** | 71.04 | 68.51 | 55.72 | 67.71 | 70.85 | |
| GSM8K | math | 73.46 | GSM8k | medium | | GSM8k | 73.46 | 83.02 | **83.09** | 71.19 | 49.51 | 76.95 | 82.11 | |
| HumanEval | coding | 67.68 | HumanEval | medium | | HumanEval | 67.68 | **87.8** | 57.32 | 45.12 | 39.02 | 50.0 | 51.83 | |
| MBPP | coding | 67.2 | MBPP+ | medium | | MBPP+ | **67.2** | 64.02 | 63.49 | 59.79 | 51.32 | 57.14 | 61.38 | |
| HumanEval | coding | 63.41 | HumanEval+ | medium | | HumanEval+ | 63.41 | **82.32** | 48.78 | 36.59 | 31.71 | 43.29 | 44.51 | |
| BBH | reasoning | 60.61 | BBH | medium | | BBH | **60.61** | 58.44 | 53.72 | 54.33 | 46.52 | 50.88 | 59.3 | |
| MMLU-Pro | knowledge | 48.38 | MMLU-Pro | medium | | MMLU-Pro | **48.38** | 48.25 | 43.55 | 42.72 | 32.71 | 39.23 | 42.45 | |
| GPQA | reasoning | 36.58 | GPQA | medium | | GPQA | **36.58** | 35.65 | 32.3 | 34.56 | 31.46 | 35.07 | 35.4 | |
| MATH | math | 34.67 | MATH lvl5 | medium | | MATH lvl5 | **34.67** | 28.85 | 22.58 | 17.22 | 6.57 | 20.09 | 25.38 | |
none scraped.