Qwen-7B-Chat-Int4

Home/Models/Qwen/Qwen-7B-Chat-Int4

Qwen/Qwen-7B-Chat-Int4

kind: gptq
quant: gptq
family: qwen
modality: text-generation
root model: Qwen/Qwen-7B
provider: Qwen
license: other
language: zh, en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 463
likes: 75
created: —
last modified: 2024-01-04T06:40:58+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen-7B-Chat-Int4
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609arxiv:2305.08322arxiv:2009.03300arxiv:2305.05280arxiv:2210.03629license:other4-bitgptqregion:us

benchmark	category	score	conf	evidence
C-Eval	knowledge	59.2	high	`\| Int4 \| 55.1 \| 59.2 \| 49.7 \| 29.9 \|`
MMLU	knowledge	55.1	high	`\| Int4 \| 55.1 \| 59.2 \| 49.7 \| 29.9 \|`
GSM8K	math	49.7	high	`\| Int4 \| 55.1 \| 59.2 \| 49.7 \| 29.9 \|`
HumanEval	coding	29.9	high	`\| Int4 \| 55.1 \| 59.2 \| 49.7 \| 29.9 \|`

none scraped.