HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

tulu-30B-fp16

TheBloke/tulu-30B-fp16

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
—
provider
TheBloke
license
other
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
128
likes
5
created
—
last modified
2023-06-13T20:02:03+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/tulu-30B-fp16
tags
transformerspytorchllamatext-generationendataset:databricks/databricks-dolly-15kdataset:OpenAssistant/oasst1dataset:sahil2801/CodeAlpaca-20karxiv:2306.04751arxiv:2302.13971arxiv:2301.13688arxiv:2304.07327arxiv:2304.03277license:othertext-generation-inferenceregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
TydiQAknowledge58.2GSM CoT | BBH CoT | TydiQA Closed-booklow| 57.7 | 58.4 | 6.0 | 51.0 | 45.8 | 48.7 | 58.2 | 12.3 | 25.4 | 46.0 | 63.5 | 44.7 |
MMLUknowledge57.7GSM CoT | BBH CoT | TydiQA Closed-booklow| 57.7 | 58.4 | 6.0 | 51.0 | 45.8 | 48.7 | 58.2 | 12.3 | 25.4 | 46.0 | 63.5 | 44.7 |
BBHreasoning45.8GSM CoT | BBH CoT | TydiQA Closed-booklow| 57.7 | 58.4 | 6.0 | 51.0 | 45.8 | 48.7 | 58.2 | 12.3 | 25.4 | 46.0 | 63.5 | 44.7 |
Codex-Evalcoding25.4GSM CoT | BBH CoT | TydiQA Closed-booklow| 57.7 | 58.4 | 6.0 | 51.0 | 45.8 | 48.7 | 58.2 | 12.3 | 25.4 | 46.0 | 63.5 | 44.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.