open-instruct-human-mix-65b

Home/Models/allenai/open-instruct-human-mix-65b

allenai/open-instruct-human-mix-65b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/open-instruct-human-mix-65b
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 158
likes: 4
created: —
last modified: 2023-06-29T18:51:34+00:00 (2023)
huggingface: https://huggingface.co/allenai/open-instruct-human-mix-65b
tags: transformerspytorchllamatext-generationendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1arxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	60.7	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 60.7 \| 61.6 \| 8.0 \| 57.5 \| 50.1 \| 52.7 \| 58.5 \| 15.9 \| 24.5 \| 43.2 \| 46.5 \| 43.8 \|`
TydiQA	knowledge	58.5	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 60.7 \| 61.6 \| 8.0 \| 57.5 \| 50.1 \| 52.7 \| 58.5 \| 15.9 \| 24.5 \| 43.2 \| 46.5 \| 43.8 \|`
BBH	reasoning	50.1	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 60.7 \| 61.6 \| 8.0 \| 57.5 \| 50.1 \| 52.7 \| 58.5 \| 15.9 \| 24.5 \| 43.2 \| 46.5 \| 43.8 \|`
Codex-Eval	coding	24.5	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 60.7 \| 61.6 \| 8.0 \| 57.5 \| 50.1 \| 52.7 \| 58.5 \| 15.9 \| 24.5 \| 43.2 \| 46.5 \| 43.8 \|`

none scraped.