Qwen-14B-Chat-Int4

Home/Models/Qwen/Qwen-14B-Chat-Int4

Qwen/Qwen-14B-Chat-Int4

kind: gptq
quant: gptq
family: qwen
modality: text-generation
root model: Qwen/Qwen-14B
provider: Qwen
license: —
language: zh, en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 330
likes: 100
created: —
last modified: 2023-12-13T15:44:35+00:00 (2023)
huggingface: https://huggingface.co/Qwen/Qwen-14B-Chat-Int4
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609arxiv:2305.08322arxiv:2009.03300arxiv:2305.05280arxiv:2210.036294-bitgptqregion:us

benchmark	category	score	conf	evidence
C-Eval	knowledge	69.0	high	`\| Int4 \| 63.3 \| 69.0 \| 59.8 \| 45.7 \|`
MMLU	knowledge	63.3	high	`\| Int4 \| 63.3 \| 69.0 \| 59.8 \| 45.7 \|`
GSM8K	math	59.8	high	`\| Int4 \| 63.3 \| 69.0 \| 59.8 \| 45.7 \|`
HumanEval	coding	45.7	high	`\| Int4 \| 63.3 \| 69.0 \| 59.8 \| 45.7 \|`

none scraped.