tulu-7b

Home/Models/allenai/tulu-7b

allenai/tulu-7b

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: allenai/tulu-7b
provider: allenai
license: —
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 75
likes: 9
created: —
last modified: 2023-06-20T17:47:54+00:00 (2023)
huggingface: https://huggingface.co/allenai/tulu-7b
tags: transformerspytorchllamatext-generationendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1dataset:sahil2801/CodeAlpaca-20karxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327arxiv:2304.03277text-generation-inferenceendpoints_compatibleregion:us

benchmark	category	score	context	conf	evidence
TydiQA	knowledge	45.7	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 44.5 \| 47.0 \| 6.0 \| 27.0 \| 38.1 \| 39.2 \| 45.7 \| 7.7 \| 17.5 \| 27.8 \| 48.3 \| 33.1 \|`
MMLU	knowledge	44.5	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 44.5 \| 47.0 \| 6.0 \| 27.0 \| 38.1 \| 39.2 \| 45.7 \| 7.7 \| 17.5 \| 27.8 \| 48.3 \| 33.1 \|`
BBH	reasoning	38.1	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 44.5 \| 47.0 \| 6.0 \| 27.0 \| 38.1 \| 39.2 \| 45.7 \| 7.7 \| 17.5 \| 27.8 \| 48.3 \| 33.1 \|`
Codex-Eval	coding	17.5	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 44.5 \| 47.0 \| 6.0 \| 27.0 \| 38.1 \| 39.2 \| 45.7 \| 7.7 \| 17.5 \| 27.8 \| 48.3 \| 33.1 \|`

none scraped.