HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUF

TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUF

kind
gguf
quant
gguf (2-bit)
family
mistral
modality
text-generation
root model
uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b
provider
TheBloke
license
llama2
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
579
likes
10
created
—
last modified
2023-11-14T01:59:42+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-GGUF
tags
transformersggufmistralllama-2codetext-generationendataset:jondurbin/airoboros-2.2.1dataset:Open-Orca/OpenOrcadataset:garage-bAInd/Open-Platypusdataset:ehartford/samantha-dataarxiv:2310.06825base_model:uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7bbase_model:quantized:uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7blicense:llama2model-indexregion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge84.4HellaSwagmedium| HellaSwag | 84.4 |
WinoGrandeknowledge78.37Winograndemedium| Winogrande | 78.37 |
MMLUknowledge63.72MMLUmedium| MMLU | 63.72 |
TruthfulQAsafety52.52TruthfulQAmedium| TruthfulQA | 52.52 |
HumanEvalcoding34.15-pythonmedium| humaneval-python | 34.146 |
GSM8Kmath21.38GSM8Kmedium| GSM8K | 21.38 |
DROPreasoning8.66DROPmedium| DROP | 8.66 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.