inclusionAI/Ling-lite-1.5
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HumanEval | coding | 87.27 | HumanEval(Pass@1) | medium | | HumanEval(Pass@1) | 0 | **87.27** | 84.38 | 81.94 | 85.29 | 72.94 | 67.23 | |
| MATH | math | 82.62 | Math(EM) | medium | | Math(EM) | 0 | **82.62** | 72.80 | 81.46 | 82.70 | 67.1 | 52.42 | |
| IFEval | instruction-following | 77.7 | IFEval(Prompt Strict) | medium | | IFEval(Prompt Strict) | 0 | **77.70** | 77.99 | 81.06 | 83.55 | 49.01 | 73.01 | |
| BBH | reasoning | 75.75 | BBH(EM) | medium | | BBH(EM) | 0 | **75.75** | 66.38 | 78.21 | 79.33 | 63.45 | 68.05 | |
| MMLU | knowledge | 74.33 | MMLU(EM) | medium | | MMLU(EM) | 5 | **74.33** | 71.27 | 70.09 | 75.97 | 70.74 | 68.67 | |
| Math Olympiad | math | 52.3 | OlympiadBench(pass@1) | medium | | OlympiadBench(pass@1) | 0 | **52.30** | 36.44 | 54.33 | 56.11 | 32.85 | 17.04 | |
| GPQA | reasoning | 36.55 | GPQA(Pass@1) | medium | | GPQA(Pass@1) | 0 | **36.55** | 29.73 | 40.4 | 47.10 | 19.51 | 27.59 | |
| LiveCodeBench | coding | 22.7 | LiveCodeBench 2408-2502 (Pass@1) | medium | | LiveCodeBench 2408-2502 (Pass@1) | 0 | **22.7** | 18.94 | 21.8 | 26.88 | 14.76 | 18.41 | |
| AIME 2024 | math | 21.88 | AIME2024(pass@1) | medium | | AIME2024(pass@1) | 0 | **21.88** | 10.21 | 20.62 | 26.25 | 6.88 | 7.29 | |
none scraped.