Qwen/Qwen3-235B-A22B-Instruct-2507-FP8
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MMLU | knowledge | 90.4 | MMLU-Redux | medium | | MMLU-Redux | 90.4 | 91.3 | **94.2** | 92.7 | 89.2 | 93.1 | |
| IFEval | instruction-following | 82.3 | IFEval | medium | | IFEval | 82.3 | 83.9 | 87.4 | **89.8** | 83.2 | 88.7 | |
| MMLU-Pro | knowledge | 81.2 | MMLU-Pro | medium | | MMLU-Pro | 81.2 | 79.8 | **86.6** | 81.1 | 75.2 | 83.0 | |
| MMLU-Pro | knowledge | 75.8 | MMLU-ProX | medium | | MMLU-ProX | 75.8 | 76.2 | - | 74.5 | 73.2 | **79.4** | |
| SimpleQA | knowledge | 71.1 | CSimpleQA | medium | | CSimpleQA | 71.1 | 60.2 | 68.0 | 74.5 | 60.8 | **84.3** | |
| GPQA | reasoning | 68.4 | GPQA | medium | | GPQA | 68.4 | 66.9 | 74.9 | 75.1 | 62.9 | **77.5** | |
| BFCL (function calling) | agentic | 64.7 | BFCL-v3 | medium | | BFCL-v3 | 64.7 | 66.5 | 60.1 | 65.2 | 68.0 | **70.9** | |
| AIME 2025 | math | 46.6 | AIME25 | medium | | AIME25 | 46.6 | 26.7 | 33.9 | 49.5 | 24.7 | **70.3** | |
| Chatbot Arena | chat | 45.6 | Arena-Hard v2* | medium | | Arena-Hard v2* | 45.6 | 61.9 | 51.5 | 66.1 | 52.0 | **79.2** | |
| LiveCodeBench | coding | 45.2 | LiveCodeBench v6 (25.02-25.05) | medium | | LiveCodeBench v6 (25.02-25.05) | 45.2 | 35.8 | 44.6 | 48.9 | 32.9 | **51.8** | |
| SimpleQA | knowledge | 27.2 | SimpleQA | medium | | SimpleQA | 27.2 | 40.3 | 22.8 | 31.0 | 12.2 | **54.3** | |
| ARC-AGI | reasoning | 9.0 | ARC-AGI | medium | | ARC-AGI | 9.0 | 8.8 | 30.3 | 13.3 | 4.3 | **41.8** | |
none scraped.