GPlatty-30B-SuperHOT-8K-fp16

Home/Models/TheBloke/GPlatty-30B-SuperHOT-8K-fp16

TheBloke/GPlatty-30B-SuperHOT-8K-fp16

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: —
provider: TheBloke
license: other
language: —
context: 8192
library: —
vRAM (GB): —
size on disk: —
downloads: 129
likes: 1
created: —
last modified: 2023-07-09T20:24:57+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/GPlatty-30B-SuperHOT-8K-fp16
tags: transformerspytorchllamatext-generationcustom_codearxiv:2302.13971license:othertext-generation-inferenceregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	84.8	HellaSwag (10-shot)	medium	`\| HellaSwag (10-shot) \| 84.8 \|`
MMLU	knowledge	63.6	MMLU (5-shot)	medium	`\| MMLU (5-shot) \| 63.6 \|`
TruthfulQA	safety	53.8	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 53.8 \|`

none scraped.