Qwen-7B-Chat-GPTQ

Home/Models/TheBloke/Qwen-7B-Chat-GPTQ

TheBloke/Qwen-7B-Chat-GPTQ

kind: gptq
quant: gptq
family: qwen
modality: text-generation
root model: Qwen/Qwen-7B-Chat
provider: TheBloke
license: —
language: zh, en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 62
likes: 3
created: —
last modified: 2023-11-21T10:36:56+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Qwen-7B-Chat-GPTQ
tags: transformerssafetensorsqwentext-generationcustom_codezhenarxiv:2309.16609arxiv:2305.08322arxiv:2009.03300arxiv:2305.05280arxiv:2210.03629base_model:Qwen/Qwen-7B-Chatbase_model:quantized:Qwen/Qwen-7B-Chat4-bitgptqregion:us

benchmark	category	score	conf	evidence
C-Eval	knowledge	59.7	low	`\| BF16 \| 55.8 \| 59.7 \| 50.3 \| 37.2 \|`
MMLU	knowledge	55.8	low	`\| BF16 \| 55.8 \| 59.7 \| 50.3 \| 37.2 \|`
GSM8K	math	50.3	low	`\| BF16 \| 55.8 \| 59.7 \| 50.3 \| 37.2 \|`
HumanEval	coding	37.2	low	`\| BF16 \| 55.8 \| 59.7 \| 50.3 \| 37.2 \|`

none scraped.