tiiuae/Falcon-H1-34B-Base
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HellaSwag | knowledge | 85.68 | HellaSwag | medium | | HellaSwag | 85.68 | 87.57 | 85.13 | 86.19 | **87.78** | 84.01 | |
| MMLU | knowledge | 83.82 | MMLU-stem | medium | | MMLU-stem | 83.82 | **84.81** | 82.81 | 76.59 | 70.35 | 72.57 | |
| MMLU | knowledge | 83.46 | MMLU | medium | | MMLU | 83.46 | **85.96** | 83.18 | 78.32 | 78.49 | 77.98 | |
| MBPP | coding | 83.33 | MBPP | medium | | MBPP | 83.33 | **87.04** | 83.07 | 76.19 | 78.84 | 77.78 | |
| WinoGrande | knowledge | 82.72 | Winogrande | medium | | Winogrande | 82.72 | 83.74 | 82.32 | 82.4 | **85.32** | 78.93 | |
| GSM8K | math | 76.5 | GSM8k | medium | | GSM8k | 76.5 | 89.76 | **90.14** | 81.35 | 80.52 | 83.24 | |
| MBPP | coding | 70.37 | MBPP+ | medium | | MBPP+ | 70.37 | **70.63** | 68.78 | 61.64 | 66.67 | 64.29 | |
| HumanEval | coding | 70.12 | HumanEval | medium | | HumanEval | **70.12** | 59.15 | 59.76 | 48.78 | 57.32 | 57.32 | |
| BBH | reasoning | 69.36 | BBH | medium | | BBH | **69.36** | 67.77 | 67.45 | 61.6 | 62.78 | 61.71 | |
| HumanEval | coding | 64.63 | HumanEval+ | medium | | HumanEval+ | **64.63** | 51.22 | 51.83 | 40.85 | 50.61 | 48.78 | |
| MMLU-Pro | knowledge | 57.18 | MMLU-Pro | medium | | MMLU-Pro | 57.18 | **60.22** | 58.05 | 49.64 | 47.07 | 50.16 | |
| GPQA | reasoning | 42.7 | GPQA | medium | | GPQA | **42.7** | 42.28 | 39.68 | 35.82 | 36.49 | 35.99 | |
| MATH | math | 40.71 | MATH lvl5 | medium | | MATH lvl5 | **40.71** | 38.14 | 36.4 | 25.38 | 18.81 | 27.19 | |
none scraped.