Yarn-Mistral-7B-128k-AWQ

Home/Models/TheBloke/Yarn-Mistral-7B-128k-AWQ

TheBloke/Yarn-Mistral-7B-128k-AWQ

kind: awq
quant: awq
family: mistral
modality: text-generation
root model: NousResearch/Yarn-Mistral-7b-128k
provider: TheBloke
license: apache-2.0
language: en
context: 128k
library: transformers
vRAM (GB): —
size on disk: —
downloads: 84
likes: 72
created: —
last modified: 2023-11-09T18:16:14+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Yarn-Mistral-7B-128k-AWQ
tags: transformerssafetensorsmistraltext-generationcustom_codeendataset:emozilla/yarn-train-tokenized-16k-mistralarxiv:2309.00071base_model:NousResearch/Yarn-Mistral-7b-128kbase_model:quantized:NousResearch/Yarn-Mistral-7b-128klicense:apache-2.0text-generation-inference4-bitawqregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	83.31		low	`\| [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 8k \| 59.98 \| 83.31 \| 64.16 \| 42.15 \|`
MMLU	knowledge	64.16		low	`\| [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 8k \| 59.98 \| 83.31 \| 64.16 \| 42.15 \|`

none scraped.