juanako-7B-UNA-GGUF

Home/Models/TheBloke/juanako-7B-UNA-GGUF

TheBloke/juanako-7B-UNA-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: fblgit/juanako-7b-UNA
provider: TheBloke
license: apache-2.0
language: —
context: 32768,
library: —
vRAM (GB): —
size on disk: —
downloads: 252
likes: 12
created: —
last modified: 2023-12-01T20:00:24+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/juanako-7B-UNA-GGUF
tags: transformersggufmistralalignment-handbookgenerated_from_trainerjuanakoUNAdataset:HuggingFaceH4/ultrafeedback_binarizedarxiv:2109.07958arxiv:2310.16944arxiv:2305.18290base_model:fblgit/juanako-7b-UNAbase_model:quantized:fblgit/juanako-7b-UNAlicense:apache-2.0model-indexregion:usconversational

benchmark	category	score	context	conf	evidence
BoolQ	knowledge	87.03		medium	`\| boolq \| Yaml \| none \| acc \| 0.8703 \| ± \| 0.0059 \|`
PIQA	knowledge	82.54		medium	`\| piqa \| Yaml \| none \| acc \| 0.8254 \| ± \| 0.0089 \|`
WinoGrande	knowledge	76.8		medium	`\| winogrande \| Yaml \| none \| acc \| 0.768 \| ± \| 0.0119 \|`
TruthfulQA	safety	65.49	_mc2	medium	`\| truthfulqa_mc2 \| Yaml \| none \| acc \| 0.6549 \| ± \| 0.0153 \|`
ARC-Challenge	knowledge	64.76	_challenge	medium	`\| arc_challenge \| Yaml \| none \| acc \| 0.6476 \| ± \| 0.0140 \|`
MMLU	knowledge	61.37		medium	`\| mmlu \| N/A \| none \| acc \| 0.6137 \| ± \| 0.1243 \|`
GSM8K	math	48.98		medium	`\| gsm8k \| Yaml \| get-answer \| exact_match \| 0.4898 \| ± \| 0.0138 \|`
TruthfulQA	safety	42.15		low	`\| [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 50.32 \| 59.58 \| 83.31 \| 64.16 \| 42.15 \| 78.37 \| 18.12 \| 6.14 \|`
HellaSwag	knowledge	10.0		medium	`HellaSwag 10`
DROP	reasoning	6.14		low	`\| [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) \| 50.32 \| 59.58 \| 83.31 \| 64.16 \| 42.15 \| 78.37 \| 18.12 \| 6.14 \|`

none scraped.