Qwen-72B-Chat-Int4

Home/Models/Qwen/Qwen-72B-Chat-Int4

Qwen/Qwen-72B-Chat-Int4

kind: gptq
quant: gptq
family: qwen
modality: text-generation
root model: Qwen/Qwen-72B
provider: Qwen
license: other
language: zh, en
context: 5
library: —
vRAM (GB): —
size on disk: —
downloads: 103
likes: 47
created: —
last modified: 2024-01-04T06:46:12+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen-72B-Chat-Int4
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609arxiv:2305.08322arxiv:2009.03300arxiv:2307.11088license:other4-bitgptqregion:us

benchmark	category	score	conf	evidence
C-Eval	knowledge	80.1	high	`\| Int4 \| 73.4 \| 80.1 \| 75.3 \| 61.6 \|`
GSM8K	math	75.3	high	`\| Int4 \| 73.4 \| 80.1 \| 75.3 \| 61.6 \|`
MMLU	knowledge	73.4	high	`\| Int4 \| 73.4 \| 80.1 \| 75.3 \| 61.6 \|`
HumanEval	coding	61.6	high	`\| Int4 \| 73.4 \| 80.1 \| 75.3 \| 61.6 \|`
QuALITY	knowledge	61.38	low	`\| ChatGPT-3.5-16k \| 60.73 \| 63.51 \| 84.00 \| 61.38 \| 78.43 \| 12.22 \| 64.84 \|`

none scraped.