rocket-3B-GGUF

Home/Models/TheBloke/rocket-3B-GGUF

TheBloke/rocket-3B-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: pansophic/rocket-3B
provider: TheBloke
license: cc-by-sa-4.0
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 2,661
likes: 40
created: —
last modified: 2023-11-23T13:36:20+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/rocket-3B-GGUF
tags: transformersggufstablelmenarxiv:2305.18290arxiv:2101.00027arxiv:2305.06161base_model:pansophic/rocket-3Bbase_model:quantized:pansophic/rocket-3Blicense:cc-by-sa-4.0region:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	76.45	HellaSwag (10-shot)	medium	`\| HellaSwag (10-shot) \| 76.45 \|`
WinoGrande	knowledge	67.8	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 67.8 \|`
TruthfulQA	safety	54.38	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 54.38 \|`
AlpacaEval	chat	45.71		low	`\| Falcon-Instruct 🦅 \| 40B \| SFT \| 5.17 \| 45.71 \|`
MMLU	knowledge	45.51	MMLU (5-shot)	medium	`\| MMLU (5-shot) \| 45.51 \|`
GSM8K	math	37.91	GSM8K (5-shot)	medium	`\| GSM8K (5-shot) \| 37.91 \|`
DROP	reasoning	24.49	DROP (3-shot)	medium	`\| DROP (3-shot) \| 24.49 \|`
MT-Bench	chat	2.75		low	`\| StableLM-Tuned-α 🦜 \| 7B \| SFT \| 2.75 \| - \|`

none scraped.