open-instruct-stanford-alpaca-7b

Home/Models/allenai/open-instruct-stanford-alpaca-7b

allenai/open-instruct-stanford-alpaca-7b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/open-instruct-stanford-alpaca-7b
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 69
likes: 12
created: —
last modified: 2023-06-20T17:50:34+00:00 (2023)
huggingface: https://huggingface.co/allenai/open-instruct-stanford-alpaca-7b
tags: transformerspytorchllamatext-generationendataset:tatsu-lab/alpacaarxiv:2306.04751arxiv:2302.13971text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	41.5	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 41.5 \| 40.3 \| 7.0 \| 10.0 \| 32.6 \| 31.8 \| 31.2 \| 7.2 \| 13.2 \| 22.0 \| 21.1 \| 23.3 \|`
BBH	reasoning	32.6	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 41.5 \| 40.3 \| 7.0 \| 10.0 \| 32.6 \| 31.8 \| 31.2 \| 7.2 \| 13.2 \| 22.0 \| 21.1 \| 23.3 \|`
TydiQA	knowledge	31.2	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 41.5 \| 40.3 \| 7.0 \| 10.0 \| 32.6 \| 31.8 \| 31.2 \| 7.2 \| 13.2 \| 22.0 \| 21.1 \| 23.3 \|`
Codex-Eval	coding	13.2	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 41.5 \| 40.3 \| 7.0 \| 10.0 \| 32.6 \| 31.8 \| 31.2 \| 7.2 \| 13.2 \| 22.0 \| 21.1 \| 23.3 \|`

none scraped.