HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

dolly-v2-7b-olive-optimized

microsoft/dolly-v2-7b-olive-optimized

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
microsoft/dolly-v2-7b-olive-optimized
provider
microsoft
license
mit
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
70
likes
5
created
—
last modified
2023-07-11T21:41:14+00:00 (2023)
huggingface
https://huggingface.co/microsoft/dolly-v2-7b-olive-optimized
tags
transformersonnxgpt_neoxtext-generationendataset:databricks/databricks-dolly-15klicense:mitregion:us

Benchmark scores (3)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge71.42low| EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 | 0.602236 |
BoolQknowledge62.63low| EleutherAI/pythia-6.9b | 0.368 | 0.604798 | 0.608524 | 0.631548 | 0.343857 | 0.761153 | 0.6263 | 0.543567 |
OpenBookQAknowledge34.8low| EleutherAI/pythia-2.8b | 0.348 | 0.585859 | 0.589582 | 0.591217 | 0.323379 | 0.73395 | 0.638226 | 0.523431 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.