Yarn-Mistral-7B-128k-GGUF

Home/Models/TheBloke/Yarn-Mistral-7B-128k-GGUF

TheBloke/Yarn-Mistral-7B-128k-GGUF

kind: gguf
quant: gguf (2-bit)
family: mistral
modality: —
root model: NousResearch/Yarn-Mistral-7b-128k
provider: TheBloke
license: apache-2.0
language: en
context: 128k
library: transformers
vRAM (GB): —
size on disk: —
downloads: 1,782
likes: 131
created: —
last modified: 2023-11-02T22:44:14+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Yarn-Mistral-7B-128k-GGUF
tags: transformersggufmistralendataset:emozilla/yarn-train-tokenized-16k-mistralarxiv:2309.00071base_model:NousResearch/Yarn-Mistral-7b-128kbase_model:quantized:NousResearch/Yarn-Mistral-7b-128klicense:apache-2.0region:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	83.31		low	`\| [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 8k \| 59.98 \| 83.31 \| 64.16 \| 42.15 \|`
MMLU	knowledge	64.16		low	`\| [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 8k \| 59.98 \| 83.31 \| 64.16 \| 42.15 \|`

none scraped.