HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Optimus-7B-GGUF

TheBloke/Optimus-7B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
Q-bert/Optimus-7B
provider
TheBloke
license
apache-2.0
language
en
context
32768,
library
—
vRAM (GB)
—
size on disk
—
downloads
458
likes
4
created
—
last modified
2023-12-07T11:17:30+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Optimus-7B-GGUF
tags
transformersggufmistralMathtext-generationendataset:meta-math/MetaMathQAbase_model:Q-bert/Optimus-7Bbase_model:quantized:Q-bert/Optimus-7Blicense:apache-2.0region:usconversational

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge85.41HellaSwag (10-shot)medium| HellaSwag (10-shot) | 85.41 |
WinoGrandeknowledge78.77Winogrande (5-shot)medium| Winogrande (5-shot) | 78.77 |
GSM8Kmath65.5GSM8K (5-shot)medium| GSM8K (5-shot) | 65.50 |
MMLUknowledge63.61MMLU (5-shot)medium| MMLU (5-shot) | 63.61 |
TruthfulQAsafety55.79TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 55.79 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.