UNA-ThePitbull-21.4B-v2-GGUF

Home/Models/bartowski/UNA-ThePitbull-21.4B-v2-GGUF

bartowski/UNA-ThePitbull-21.4B-v2-GGUF

kind: gguf
quant: gguf (1-bit)
family: misc
modality: text-generation
root model: —
provider: bartowski
license: afl-3.0
language: —
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 356
likes: 9
created: —
last modified: 2024-05-30T12:49:08+00:00 (2024)
huggingface: https://huggingface.co/bartowski/UNA-ThePitbull-21.4B-v2-GGUF
tags: transformersggufUNAjuanakotext-generationdataset:jondurbin/py-dpo-v0.1dataset:Replete-AI/code_bagel_hermes-2.5dataset:mlabonne/orpo-dpo-mix-40klicense:afl-3.0model-indexendpoints_compatibleregion:usimatrixconversational

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	91.79	HellaSwag (10-Shot)	medium	`\| HellaSwag (10-Shot) \| 91.79 \|`
WinoGrande	knowledge	87.37	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 87.37 \|`
WinoGrande	knowledge	86.35		medium	`\| winogrande \| 1 \| none \| 5 \| acc \| 0.8635 \| ± \| 0.0097 \|`
BoolQ	knowledge	84.01		medium	`\| boolq \| 2 \| none \| 0 \| acc \| 0.8401 \| ± \| 0.0064 \|`
TruthfulQA	safety	79.02	_mc2	medium	`\| truthfulqa_mc2 \| 2 \| none \| 0 \| acc \| 0.7902 \| ± \| 0.0134 \|`
TruthfulQA	safety	78.24	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 78.24 \|`
GSM8K	math	75.66		medium	`\| gsm8k \| 3 \| strict-match \| 5 \| exact_match \| 0.7566 \| ± \| 0.0118 \|`
MMLU	knowledge	68.25	MMLU (5-Shot)	medium	`\| MMLU (5-Shot) \| 68.25 \|`
MMLU	knowledge	64.44		medium	`\| mmlu \| N/A \| none \| 0 \| acc \| 0.6444 \| ± \| 0.0038 \|`
GSM8K	math	63.53	GSM8k (5-shot)	medium	`\| GSM8k (5-shot) \| 63.53 \|`
ARC-Challenge	knowledge	25.0	_challenge	medium	`\| arc_challenge \| 1 \| none \| 25 \| acc \| 0.7747 \| ± \| 0.0122 \|`
HellaSwag	knowledge	10.0		medium	`\| hellaswag \| 1 \| none \| 10 \| acc \| 0.8168 \| ± \| 0.0039 \|`

none scraped.