Qwen-1_8B-Chat-Int8

Home/Models/Qwen/Qwen-1_8B-Chat-Int8

Qwen/Qwen-1_8B-Chat-Int8

kind: gptq
quant: gptq
family: qwen
modality: text-generation
root model: Qwen/Qwen-1_8B
provider: Qwen
license: —
language: zh, en
context: 8192
library: —
vRAM (GB): —
size on disk: —
downloads: 108
likes: 5
created: —
last modified: 2023-12-13T15:43:42+00:00 (2023)
huggingface: https://huggingface.co/Qwen/Qwen-1_8B-Chat-Int8
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609arxiv:2305.08322arxiv:2009.033008-bitgptqregion:us

benchmark	category	score	conf	evidence
C-Eval	knowledge	55.8	high	`\| Int8 \| 43.1 \| 55.8 \| 33.0 \| 27.4 \|`
MMLU	knowledge	43.1	high	`\| Int8 \| 43.1 \| 55.8 \| 33.0 \| 27.4 \|`
GSM8K	math	33.0	high	`\| Int8 \| 43.1 \| 55.8 \| 33.0 \| 27.4 \|`
HumanEval	coding	27.4	high	`\| Int8 \| 43.1 \| 55.8 \| 33.0 \| 27.4 \|`

none scraped.