tulu-13B-GGUF

Home/Models/TheBloke/tulu-13B-GGUF

TheBloke/tulu-13B-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: allenai/tulu-13b
provider: TheBloke
license: other
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 172
likes: 0
created: —
last modified: 2023-09-27T12:52:12+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/tulu-13B-GGUF
tags: transformersggufllamaendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1dataset:sahil2801/CodeAlpaca-20karxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327arxiv:2304.03277base_model:allenai/tulu-13bbase_model:quantized:allenai/tulu-13blicense:otherregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	49.2	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 49.2 \| 51.8 \| 5.0 \| 36.5 \| 41.3 \| 42.8 \| 46.1 \| 9.2 \| 21.3 \| 35.0 \| 53.9 \| 37.2 \|`
TydiQA	knowledge	46.1	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 49.2 \| 51.8 \| 5.0 \| 36.5 \| 41.3 \| 42.8 \| 46.1 \| 9.2 \| 21.3 \| 35.0 \| 53.9 \| 37.2 \|`
BBH	reasoning	41.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 49.2 \| 51.8 \| 5.0 \| 36.5 \| 41.3 \| 42.8 \| 46.1 \| 9.2 \| 21.3 \| 35.0 \| 53.9 \| 37.2 \|`
Codex-Eval	coding	21.3	GSM CoT \| BBH CoT \| TydiQA Closed-book	low	`\| 49.2 \| 51.8 \| 5.0 \| 36.5 \| 41.3 \| 42.8 \| 46.1 \| 9.2 \| 21.3 \| 35.0 \| 53.9 \| 37.2 \|`

none scraped.