Upstage-Llama-2-70B-instruct-v2-GPTQ

Home/Models/TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ

TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ

kind: gptq
quant: gptq
family: llama
modality: text-generation
root model: upstage/Llama-2-70b-instruct-v2
provider: TheBloke
license: llama2
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 48
likes: 18
created: —
last modified: 2023-10-18T23:29:21+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ
tags: transformerssafetensorsllamatext-generationupstagellama-2instructinstructionenbase_model:upstage/SOLAR-0-70b-16bitbase_model:quantized:upstage/SOLAR-0-70b-16bitlicense:llama2text-generation-inference4-bitgptqregion:us

benchmark	category	score	conf	evidence
HellaSwag	knowledge	87.9	low	`\| [Llama-2-70b-instruct-v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2)(*Ours, Open LLM Leaderboard) \| 73* \| 71.1 \| 87.9 \| 70.6 \| 62.2`
MMLU	knowledge	70.6	low	`\| [Llama-2-70b-instruct-v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2)(*Ours, Open LLM Leaderboard) \| 73* \| 71.1 \| 87.9 \| 70.6 \| 62.2`
TruthfulQA	safety	62.2	low	`\| [Llama-2-70b-instruct-v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2)(*Ours, Open LLM Leaderboard) \| 73* \| 71.1 \| 87.9 \| 70.6 \| 62.2`

none scraped.