HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3-235B-A22B-Thinking-2507

Qwen/Qwen3-235B-A22B-Thinking-2507

kind
original
quant
bf16 (16-bit)
family
qwen
modality
text-generation
root model
Qwen/Qwen3-235B-A22B-Thinking-2507
provider
Qwen
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
20,387
likes
408
created
—
last modified
2025-08-17T08:20:17+00:00 (2025)
huggingface
https://huggingface.co/Qwen/Qwen3-235B-A22B-Thinking-2507
tags
transformerssafetensorsqwen3_moetext-generationconversationalarxiv:2402.17463arxiv:2407.02490arxiv:2501.15383arxiv:2404.06654arxiv:2505.09388license:apache-2.0eval-resultsendpoints_compatibledeploy:azureregion:us

Benchmark scores (10)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge93.4MMLU-Reduxmedium| MMLU-Redux | 93.4 | 92.8 | **94.9** | 94.4 | 94.6 | 92.7 | 93.8 |
AIME 2025math87.5AIME25medium| AIME25 | 87.5 | **92.7*** | 88.9* | 88.0 | 75.5 | 81.5 | 92.3 |
MMLU-Proknowledge85.0MMLU-Promedium| MMLU-Pro | 85.0 | 81.9 | **85.9** | 85.6 | - | 82.8 | 84.4 |
GPQAreasoning81.0GPQAmedium| GPQA | 81.0 | 81.4* | 83.3* | **86.4** | 79.6 | 71.1 | 81.1 |
MMLU-Proknowledge80.6MMLU-ProXmedium| MMLU-ProX | 80.6 | 79.0 | 83.3 | **84.7** | - | 80.0 | 81.0 |
IFEvalinstruction-following79.1IFEvalmedium| IFEval | 79.1 | **92.4** | 92.1 | 90.8 | 89.7 | 83.4 | 87.8 |
Chatbot Arenachat72.2Arena-Hard v2$medium| Arena-Hard v2$ | 72.2 | 59.3 | **80.8** | 72.5 | 59.1 | 61.5 | 79.7 |
LiveCodeBenchcoding68.7LiveCodeBench v6 (25.02-25.05)medium| LiveCodeBench v6 (25.02-25.05) | 68.7 | 71.8 | 58.6 | 72.5 | 48.9 | 55.7 | **74.1** |
BFCL (function calling)agentic63.8BFCL-v3medium| BFCL-v3 | 63.8 | 67.2 | **72.4** | 67.2 | 61.8 | 70.8 | 71.9 |
Humanity's Last Examknowledge18.1HLEmedium| HLE | 17.7# | 18.1* | 20.3 | **21.6** | 10.7 | 11.8# | 18.2# |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.