Qwen-72B

Home/Models/Qwen/Qwen-72B

Qwen/Qwen-72B

kind: original
quant: bf16 (16-bit)
family: qwen
modality: text-generation
root model: Qwen/Qwen-72B
provider: Qwen
license: other
language: zh, en
context: 32k
library: —
vRAM (GB): —
size on disk: —
downloads: 1,194,928
likes: 360
created: —
last modified: 2024-10-09T05:59:26+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen-72B
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609license:otherregion:us

benchmark	category	score	conf	evidence
MMLU	knowledge	46.8	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
BBH	reasoning	38.2	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
C-Eval	knowledge	32.5	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
CMMLU	knowledge	31.8	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
AGIEval	reasoning	21.8	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
MBPP	coding	20.8	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
GAOKAO	knowledge	18.9	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
GSM8K	math	16.7	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
HumanEval	coding	12.8	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`
MATH	math	3.3	low	`\| LLaMA2-7B \| 24.4 \| 46.8 \| 32.5 \| 16.7 \| 3.3 \| 12.8 \| 20.8 \| 38.2 \| 21.8 \| 18.9 \| 31.8 \|`

none scraped.