HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

tulu-7B-GGUF

TheBloke/tulu-7B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
allenai/tulu-7b
provider
TheBloke
license
other
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
276
likes
1
created
—
last modified
2023-09-27T12:53:39+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/tulu-7B-GGUF
tags
transformersggufllamaendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1dataset:sahil2801/CodeAlpaca-20karxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327arxiv:2304.03277base_model:allenai/tulu-7bbase_model:quantized:allenai/tulu-7blicense:otherregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
TydiQAknowledge45.7GSM CoT | BBH CoT | TydiQA Closed-booklow| 44.5 | 47.0 | 6.0 | 27.0 | 38.1 | 39.2 | 45.7 | 7.7 | 17.5 | 27.8 | 48.3 | 33.1 |
MMLUknowledge44.5GSM CoT | BBH CoT | TydiQA Closed-booklow| 44.5 | 47.0 | 6.0 | 27.0 | 38.1 | 39.2 | 45.7 | 7.7 | 17.5 | 27.8 | 48.3 | 33.1 |
BBHreasoning38.1GSM CoT | BBH CoT | TydiQA Closed-booklow| 44.5 | 47.0 | 6.0 | 27.0 | 38.1 | 39.2 | 45.7 | 7.7 | 17.5 | 27.8 | 48.3 | 33.1 |
Codex-Evalcoding17.5GSM CoT | BBH CoT | TydiQA Closed-booklow| 44.5 | 47.0 | 6.0 | 27.0 | 38.1 | 39.2 | 45.7 | 7.7 | 17.5 | 27.8 | 48.3 | 33.1 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.