supermario-v2-GGUF

Home/Models/TheBloke/supermario-v2-GGUF

TheBloke/supermario-v2-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: janhq/supermario-v2
provider: TheBloke
license: apache-2.0
language: en
context: 32768,
library: —
vRAM (GB): —
size on disk: —
downloads: 205
likes: 5
created: —
last modified: 2023-12-12T15:38:39+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/supermario-v2-GGUF
tags: transformersggufmistralenbase_model:jan-hq/supermario-v2base_model:quantized:jan-hq/supermario-v2license:apache-2.0region:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	86.51	HellaSwag (10-shot)	medium	`\| HellaSwag (10-shot) \| 86.51 \|`
WinoGrande	knowledge	81.37	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 81.37 \|`
GSM8K	math	72.18	GSM8K (5-shot)	medium	`\| GSM8K (5-shot) \| 72.18 \|`
MMLU	knowledge	64.88	MMLU (5-shot)	medium	`\| MMLU (5-shot) \| 64.88 \|`
TruthfulQA	safety	60.58	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 60.58 \|`

none scraped.