neural-chat-7B-v3-3-GGUF

Home/Models/TheBloke/neural-chat-7B-v3-3-GGUF

TheBloke/neural-chat-7B-v3-3-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: Intel/neural-chat-7b-v3-3
provider: TheBloke
license: apache-2.0
language: —
context: 32768,
library: —
vRAM (GB): —
size on disk: —
downloads: 408
likes: 14
created: —
last modified: 2023-12-12T09:51:45+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/neural-chat-7B-v3-3-GGUF
tags: transformersggufmistralbase_model:Intel/neural-chat-7b-v3-3base_model:quantized:Intel/neural-chat-7b-v3-3license:apache-2.0region:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	85.26	HellaSwag (10-shot)	medium	`\| HellaSwag (10-shot) \| 85.26 \|`
WinoGrande	knowledge	79.64	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 79.64 \|`
MMLU	knowledge	63.07	MMLU (5-shot)	medium	`\| MMLU (5-shot) \| 63.07 \|`
TruthfulQA	safety	63.01	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 63.01 \|`
GSM8K	math	61.11	GSM8K (5-shot)	medium	`\| GSM8K (5-shot) \| 61.11 \|`

none scraped.