open-instruct-pythia-6.9b-tulu

Home/Models/allenai/open-instruct-pythia-6.9b-tulu

allenai/open-instruct-pythia-6.9b-tulu

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/open-instruct-pythia-6.9b-tulu
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 77
likes: 6
created: —
last modified: 2023-06-13T18:28:57+00:00 (2023)
huggingface: https://huggingface.co/allenai/open-instruct-pythia-6.9b-tulu
tags: transformerspytorchgpt_neoxtext-generationendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1dataset:sahil2801/CodeAlpaca-20karxiv:2306.04751arxiv:2304.01373arxiv:2301.13688arxiv:2304.07327arxiv:2304.03277text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	34.1	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 34.1 \| 34.6 \| 3.5 \| 15.5 \| 31.3 \| 27.8 \| 33.4 \| 3.8 \| 14.3 \| 21.4 \| 9.2 \| 19.8 \|`
TydiQA	knowledge	33.4	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 34.1 \| 34.6 \| 3.5 \| 15.5 \| 31.3 \| 27.8 \| 33.4 \| 3.8 \| 14.3 \| 21.4 \| 9.2 \| 19.8 \|`
BBH	reasoning	31.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 34.1 \| 34.6 \| 3.5 \| 15.5 \| 31.3 \| 27.8 \| 33.4 \| 3.8 \| 14.3 \| 21.4 \| 9.2 \| 19.8 \|`
Codex-Eval	coding	14.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 34.1 \| 34.6 \| 3.5 \| 15.5 \| 31.3 \| 27.8 \| 33.4 \| 3.8 \| 14.3 \| 21.4 \| 9.2 \| 19.8 \|`

none scraped.