open-instruct-unnatural-instructions-7b

Home/Models/allenai/open-instruct-unnatural-instructions-7b

allenai/open-instruct-unnatural-instructions-7b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/open-instruct-unnatural-instructions-7b
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 59
likes: 1
created: —
last modified: 2023-06-20T17:50:10+00:00 (2023)
huggingface: https://huggingface.co/allenai/open-instruct-unnatural-instructions-7b
tags: transformerspytorchllamatext-generationendataset:mrm8488/unnatural-instructionsarxiv:2306.04751arxiv:2302.13971arxiv:2212.09689text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	42.9	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 42.9 \| 38.1 \| 3.5 \| 5.0 \| 31.4 \| 30.0 \| 36.3 \| 6.5 \| 10.3 \| 19.8 \| 8.2 \| 20.0 \|`
TydiQA	knowledge	36.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 42.9 \| 38.1 \| 3.5 \| 5.0 \| 31.4 \| 30.0 \| 36.3 \| 6.5 \| 10.3 \| 19.8 \| 8.2 \| 20.0 \|`
BBH	reasoning	31.4	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 42.9 \| 38.1 \| 3.5 \| 5.0 \| 31.4 \| 30.0 \| 36.3 \| 6.5 \| 10.3 \| 19.8 \| 8.2 \| 20.0 \|`
Codex-Eval	coding	10.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 42.9 \| 38.1 \| 3.5 \| 5.0 \| 31.4 \| 30.0 \| 36.3 \| 6.5 \| 10.3 \| 19.8 \| 8.2 \| 20.0 \|`

none scraped.