Llama-2-70B-Chat-AWQ

Home/Models/TheBloke/Llama-2-70B-Chat-AWQ

TheBloke/Llama-2-70B-Chat-AWQ

kind: awq
quant: awq
family: llama
modality: text-generation
root model: meta-llama/Llama-2-70b-chat-hf
provider: TheBloke
license: llama2
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 414
likes: 24
created: —
last modified: 2023-11-09T18:21:09+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Llama-2-70B-Chat-AWQ
tags: transformerssafetensorsllamatext-generationfacebookmetapytorchllama-2enarxiv:2307.09288base_model:meta-llama/Llama-2-70b-chat-hfbase_model:quantized:meta-llama/Llama-2-70b-chat-hflicense:llama2text-generation-inference4-bitawqregion:us

benchmark	category	score	conf	evidence
MMLU	knowledge	35.1	low	`\| Llama 1 \| 7B \| 14.1 \| 60.8 \| 46.2 \| 58.5 \| 6.95 \| 35.1 \| 30.3 \| 23.9 \|`
BBH	reasoning	30.3	low	`\| Llama 1 \| 7B \| 14.1 \| 60.8 \| 46.2 \| 58.5 \| 6.95 \| 35.1 \| 30.3 \| 23.9 \|`
AGIEval	reasoning	23.9	low	`\| Llama 1 \| 7B \| 14.1 \| 60.8 \| 46.2 \| 58.5 \| 6.95 \| 35.1 \| 30.3 \| 23.9 \|`
MATH	math	6.95	low	`\| Llama 1 \| 7B \| 14.1 \| 60.8 \| 46.2 \| 58.5 \| 6.95 \| 35.1 \| 30.3 \| 23.9 \|`

none scraped.