HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/Qwen/Qwen/Qwen-72B

Qwen/Qwen-72B

family qwen · 4 variants · unknown

provider
Qwen
released
—
huggingface
https://huggingface.co/Qwen/Qwen-72B
best scores
MMLU: 74.4C-Eval: 80.1GSM8K: 76.4MATH: 3.3HumanEval: 64.6MBPP: 20.8BBH: 38.2AGIEval: 21.8GAOKAO: 18.9CMMLU: 31.8QuALITY: 61.38

Best scores per benchmark

benchmarkcategorybest score
C-Evalknowledge80.1
GSM8Kmath76.4
MMLUknowledge74.4
HumanEvalcoding64.6
QuALITYknowledge61.38
BBHreasoning38.2
CMMLUknowledge31.8
AGIEvalreasoning21.8
MBPPcoding20.8
GAOKAOknowledge18.9
MATHmath3.3

Variants (4)

variantkindquantbitsvRAMdlorgyear
Qwen-72Boriginalbf1616.01,194,928Qwen2024
Qwen-72B-Chatoriginalbf1616.0226Qwen2024
Qwen-72B-Chat-Int4gptqgptq103Qwen2024
Qwen-72B-Chat-Int8gptqgptq100Qwen2024
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.