open-instruct-human-mix-7b

Home/Models/allenai/open-instruct-human-mix-7b

allenai/open-instruct-human-mix-7b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/open-instruct-human-mix-7b
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 61
likes: 0
created: —
last modified: 2023-06-20T17:46:37+00:00 (2023)
huggingface: https://huggingface.co/allenai/open-instruct-human-mix-7b
tags: transformerspytorchllamatext-generationendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1arxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	46.2	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 46.2 \| 48.0 \| 4.5 \| 26.5 \| 35.6 \| 34.8 \| 42.2 \| 7.7 \| 9.4 \| 20.2 \| 29.4 \| 27.8 \|`
TydiQA	knowledge	42.2	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 46.2 \| 48.0 \| 4.5 \| 26.5 \| 35.6 \| 34.8 \| 42.2 \| 7.7 \| 9.4 \| 20.2 \| 29.4 \| 27.8 \|`
BBH	reasoning	35.6	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 46.2 \| 48.0 \| 4.5 \| 26.5 \| 35.6 \| 34.8 \| 42.2 \| 7.7 \| 9.4 \| 20.2 \| 29.4 \| 27.8 \|`
Codex-Eval	coding	9.4	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 46.2 \| 48.0 \| 4.5 \| 26.5 \| 35.6 \| 34.8 \| 42.2 \| 7.7 \| 9.4 \| 20.2 \| 29.4 \| 27.8 \|`

none scraped.