Mungert/Mellum2-12B-A2.5B-Thinking-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MMLU | knowledge | 84.8 | MMLU-Redux | medium | | MMLU-Redux | 84.8 | 86.2 | 88.3 | 91.7 | 71.3 | 84.4 | |
| LiveCodeBench | coding | 75.1 | LiveCodeBench v6 | medium | | LiveCodeBench v6 | 75.1 | 69.9 | 59.4 | 68.3 | 59.8 | 42.7 | |
| IFEval | instruction-following | 69.1 | IFEval | medium | | IFEval | 69.1 | 76.5 | 87.1 | 89.8 | 84.7 | 59.7 | |
| BFCL (function calling) | agentic | 60.5 | BFCL v3 | medium | | BFCL v3 | 60.5 | 69.4 | 73.9 | 68.5 | — | 52.2 | |
| GPQA Diamond | reasoning | 39.9 | GPQA Diamond | medium | | GPQA Diamond | 39.9 | 57.6 | 76.8 | 81.3 | 29.3 | 46.0 | |
| BFCL (function calling) | agentic | 38.8 | BFCL v4 | medium | | BFCL v4 | 38.8 | 45.6 | 42.9 | 42.7 | — | 35.9 | |
none scraped.