digital-socrates-7b

Home/Models/allenai/digital-socrates-7b

allenai/digital-socrates-7b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/digital-socrates-7b
provider: allenai
license: apache-2.0
language: —
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 107
likes: 6
created: —
last modified: 2024-09-02T19:21:15+00:00 (2024)
huggingface: https://huggingface.co/allenai/digital-socrates-7b
tags: transformerspytorchllamatext-generationenarxiv:2311.09613license:apache-2.0model-indextext-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	75.99	HellaSwag (10-Shot)	medium	`\| HellaSwag (10-Shot) \| 75.99 \|`
WinoGrande	knowledge	73.09	Winogrande (5-shot)	medium	`\| Winogrande (5-shot) \| 73.09 \|`
MMLU	knowledge	51.41	MMLU (5-Shot)	medium	`\| MMLU (5-Shot) \| 51.41 \|`
TruthfulQA	safety	44.88	TruthfulQA (0-shot)	medium	`\| TruthfulQA (0-shot) \| 44.88 \|`
GSM8K	math	17.89	GSM8k (5-shot)	medium	`\| GSM8k (5-shot) \| 17.89 \|`

none scraped.