digital-socrates-13b

Home/Models/allenai/digital-socrates-13b

allenai/digital-socrates-13b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/digital-socrates-13b
provider: allenai
license: apache-2.0
language: —
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 109
likes: 10
created: —
last modified: 2024-09-02T19:21:33+00:00 (2024)
huggingface: https://huggingface.co/allenai/digital-socrates-13b
tags: transformerspytorchllamatext-generationenarxiv:2311.09613license:apache-2.0model-indextext-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	80.14	HellaSwag (10-Shot)	medium	`\| HellaSwag (10-Shot) \| 80.14 \|`
WinoGrande	knowledge	74.59	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 74.59 \|`
MMLU	knowledge	57.01	MMLU (5-Shot)	medium	`\| MMLU (5-Shot) \| 57.01 \|`
TruthfulQA	safety	44.47	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 44.47 \|`
GSM8K	math	29.49	GSM8k (5-shot)	medium	`\| GSM8k (5-shot) \| 29.49 \|`

none scraped.