HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mistral-7B-OpenOrca-GGUF

TheBloke/Mistral-7B-OpenOrca-GGUF

kind
gguf
quant
gguf (2-bit)
family
mistral
modality
text-generation
root model
Open-Orca/Mistral-7B-OpenOrca
provider
TheBloke
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
3,564
likes
243
created
—
last modified
2023-10-02T23:16:16+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF
tags
transformersggufmistraltext-generationendataset:Open-Orca/OpenOrcaarxiv:2306.02707arxiv:2301.13688base_model:Open-Orca/Mistral-7B-OpenOrcabase_model:quantized:Open-Orca/Mistral-7B-OpenOrcalicense:apache-2.0region:us

Benchmark scores (3)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge83.79HellaSwag (10-shot)medium| HellaSwag (10-shot) | 83.79 |
MMLUknowledge61.73MMLU (5-shot)medium| MMLU (5-shot) | 61.73 |
TruthfulQAsafety52.24TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 52.24 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.