Fennec-Mixtral-8x7B-GGUF

Home/Models/TheBloke/Fennec-Mixtral-8x7B-GGUF

TheBloke/Fennec-Mixtral-8x7B-GGUF

kind: gguf
quant: gguf (2-bit)
family: mistral
modality: —
root model: orangetin/Fennec-Mixtral-8x7B
provider: TheBloke
license: apache-2.0
language: en
context: 32768,
library: —
vRAM (GB): —
size on disk: —
downloads: 216
likes: 4
created: —
last modified: 2023-12-19T00:09:03+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/Fennec-Mixtral-8x7B-GGUF
tags: transformersggufmixtralinstructfinetunellamagpt4synthetic datadistillationenbase_model:orangetin/OpenHermes-Mixtral-8x7Bbase_model:quantized:orangetin/OpenHermes-Mixtral-8x7Blicense:apache-2.0region:usconversational

benchmark	category	score	context	conf	evidence
ARC-Challenge	knowledge	60.75	_challenge	medium	`\| arc_challenge \| 0 \| acc \| 0.6075 \| ± \| 0.0143 \|`
TruthfulQA	safety	42.72	_mc	medium	`\| truthfulqa_mc \| 1 \| mc1 \| 0.4272 \| ± \| 0.0173 \|`

none scraped.