Yi-34B-Chat-AWQ

Home/Models/TheBloke/Yi-34B-Chat-AWQ

TheBloke/Yi-34B-Chat-AWQ

kind: awq
quant: awq
family: yi
modality: text-generation
root model: 01-ai/Yi-34B-Chat
provider: TheBloke
license: other
language: —
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 52
likes: 14
created: —
last modified: 2023-11-23T19:22:14+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Yi-34B-Chat-AWQ
tags: transformerssafetensorsllamatext-generationconversationalbase_model:01-ai/Yi-34B-Chatbase_model:quantized:01-ai/Yi-34B-Chatlicense:othertext-generation-inference4-bitawqregion:us

benchmark	category	score	conf	evidence
CMMLU	knowledge	79.11	high	`\| Yi-34B-Chat \| 67.62 \| 73.46 \| 79.11 \| 81.34 \| 77.04 \| 78.53 \| 62.43 \| 51.41 \| 71.74 \| 71.65 \| 75.97 \|`
C-Eval	knowledge	77.04	high	`\| Yi-34B-Chat \| 67.62 \| 73.46 \| 79.11 \| 81.34 \| 77.04 \| 78.53 \| 62.43 \| 51.41 \| 71.74 \| 71.65 \| 75.97 \|`
GSM8K	math	71.65	high	`\| Yi-34B-Chat \| 67.62 \| 73.46 \| 79.11 \| 81.34 \| 77.04 \| 78.53 \| 62.43 \| 51.41 \| 71.74 \| 71.65 \| 75.97 \|`
MMLU	knowledge	67.62	high	`\| Yi-34B-Chat \| 67.62 \| 73.46 \| 79.11 \| 81.34 \| 77.04 \| 78.53 \| 62.43 \| 51.41 \| 71.74 \| 71.65 \| 75.97 \|`
BBH	reasoning	51.41	high	`\| Yi-34B-Chat \| 67.62 \| 73.46 \| 79.11 \| 81.34 \| 77.04 \| 78.53 \| 62.43 \| 51.41 \| 71.74 \| 71.65 \| 75.97 \|`
GAOKAO	knowledge	49.8	low	`\| LLaMA2-70B \| 68.9 \| 53.3 \| - \| 49.8 \| 51.2 \| 71.9 \| 69.4 \| 36.8 \|`
MATH	math	26.0	low	`\| LLaMA2-34B \| 62.6 \| - \| - \| - \| 44.1 \| 69.9 \| 68.0 \| 26.0 \|`

none scraped.