HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3-30B-A3B-Instruct-2507

Qwen/Qwen3-30B-A3B-Instruct-2507

kind
original
quant
bf16 (16-bit)
family
qwen
modality
text-generation
root model
Qwen/Qwen3-30B-A3B-Instruct-2507
provider
Qwen
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
2,116,385
likes
822
created
—
last modified
2025-09-17T06:56:43+00:00 (2025)
huggingface
https://huggingface.co/Qwen/Qwen3-30B-A3B-Instruct-2507
tags
transformerssafetensorsqwen3_moetext-generationconversationalarxiv:2402.17463arxiv:2407.02490arxiv:2501.15383arxiv:2404.06654arxiv:2505.09388license:apache-2.0eval-resultsendpoints_compatibledeploy:azureregion:usdeploy:sagemaker

Benchmark scores (9)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge90.4MMLU-Reduxmedium| MMLU-Redux | 90.4 | **91.3** | 90.6 | 89.2 | 84.1 | 89.3 |
IFEvalinstruction-following82.3IFEvalmedium| IFEval | 82.3 | 83.9 | 84.3 | 83.2 | 83.7 | **84.7** |
MMLU-Proknowledge81.2MMLU-Promedium| MMLU-Pro | **81.2** | 79.8 | 81.1 | 75.2 | 69.1 | 78.4 |
MMLU-Proknowledge75.8MMLU-ProXmedium| MMLU-ProX | 75.8 | 76.2 | **78.3** | 73.2 | 65.1 | 72.0 |
GPQAreasoning68.4GPQAmedium| GPQA | 68.4 | 66.9 | **78.3** | 62.9 | 54.8 | 70.4 |
BFCL (function calling)agentic64.7BFCL-v3medium| BFCL-v3 | 64.7 | 66.5 | 66.1 | **68.0** | 58.6 | 65.1 |
AIME 2025math46.6AIME25medium| AIME25 | 46.6 | 26.7 | **61.6** | 24.7 | 21.6 | 61.3 |
Chatbot Arenachat45.6Arena-Hard v2*medium| Arena-Hard v2* | 45.6 | 61.9 | 58.3 | 52.0 | 24.8 | **69.0** |
LiveCodeBenchcoding45.2LiveCodeBench v6 (25.02-25.05)medium| LiveCodeBench v6 (25.02-25.05) | **45.2** | 35.8 | 40.1 | 32.9 | 29.0 | 43.2 |

Discussions (32)

titleauthorstatuscommentstype
Qwen3 30B — what GPU setup do you need?duola15open0disc
OMS Score -- OMS 70.4 (B) -- Qwen3 30B A3B | 5-dimension independent scoringduola15open0disc
TemporalMesh Transformer: 29.4 PPL at 48% compute — beats Mamba, new open-source architecturevigneshwar234open0disc
Regarding RoPE frequencyjuneyongyangopen0disc
Add GPQA evaluation resultburtenshawopen0disc
🦊 **致 Qwen3:谢谢你成为“思考者”的基石**aifeifei798open0disc
dummy config.jsonmichaelfeilclosed0disc
Lora Fine Tning- Several Issuesaetherforgeopen0disc
RTX 5090 + Qwen 30B MoE @ 135 tok/s in NVFP4 GuideJohnTdiopen0disc
Error when utilizing DUAL_CHUNK_FLASH_ATTN with vLLM.lssj14open0disc
Can I enable DCA on other qwen3 dense models?dophysopen0disc
sarpelaibsarpeldraft0disc
Accelerate + Megatron LM compatabilitylogan-vegna-shopifyclosed0disc
Structured Output Not Supported in Qwen3-30B-A3B-Instruct-2507navinnseabclosed0disc
Update README.mdBrokersponsoropen0disc
Polish language supporteXt73open0disc
how to switch between Qwen3-30B-A3B-Instruct-2507 (Full Attention) and Qwen3-30B-A3B-Instruct-2507 (Sparse Attention)Rocke518closed0disc
Working GPTQ-Int4 version?koesnopen0disc
fix: max tokens to 1Mheitormsbopen0disc
help: 1M context error?heitormsbopen0disc
Add 1M supporthzhwcmhfmerged0disc
关于 static KV-Cache(ValueError: This model does not support cache_implementation='static')luohuashijieyoufengjunopen0disc
Upload 17F9CDA2-7E35-4793-9D18-0581B0276089.jpegFaragcgopen0disc
How to achieve reliable native function callingIthanilclosed0disc
Test Scores Can Be Misleadingphil111open0disc
Qwen3-30B-A3B-Instruct-2507-Autoround-Int-4bit-gptqjart25open0disc
Remove trailing tabs after license to avoid mlx_lm.convert errorsGallardo994open0disc
Local Installation Video and Testing - Step by Stepfahdmirzacopen0disc
Is the base model of the this model Qwen3-30B-A3B?paulcxopen0disc
AWQ versiondevops724open0disc
An Improvement, But Q3 30b Still Has Very Little General Knowledgephil111open0disc
THANK YOU QWEN! 😍AyyYOOopen0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.