HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-2-7B-32K-Instruct-GPTQ

TheBloke/Llama-2-7B-32K-Instruct-GPTQ

kind
gptq
quant
gptq
family
llama
modality
text-generation
root model
togethercomputer/Llama-2-7B-32K-Instruct
provider
TheBloke
license
llama2
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
46
likes
27
created
—
last modified
2023-09-27T12:45:53+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Llama-2-7B-32K-Instruct-GPTQ
tags
transformerssafetensorsllamatext-generationcustom_codeendataset:togethercomputer/llama-instructarxiv:2307.03172base_model:togethercomputer/Llama-2-7B-32K-Instructbase_model:quantized:togethercomputer/Llama-2-7B-32K-Instructlicense:llama2text-generation-inference4-bitgptqregion:us

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.