HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mistral-11B-OmniMix-GGUF

TheBloke/Mistral-11B-OmniMix-GGUF

kind
gguf
quant
gguf (16-bit)
family
mistral
modality
—
root model
NeverSleep/Mistral-11B-OmniMix-bf16
provider
TheBloke
license
cc-by-nc-4.0
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
439
likes
15
created
—
last modified
2023-10-15T21:58:58+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Mistral-11B-OmniMix-GGUF
tags
transformersggufmistralbase_model:NeverSleep/Mistral-11B-OmniMix-bf16base_model:quantized:NeverSleep/Mistral-11B-OmniMix-bf16license:cc-by-nc-4.0region:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
PIQAknowledge81.45medium| piqa | 0 | acc | 0.8145 | ± | 0.0091 |
WinoGrandeknowledge74.27medium| winogrande | 0 | acc | 0.7427 | ± | 0.0123 |
HellaSwagknowledge63.72medium| hellaswag | 0 | acc | 0.6372 | ± | 0.0048 |
ARC-Challengeknowledge55.8_challengemedium| arc_challenge | 0 | acc | 0.5580 | ± | 0.0145 |
TruthfulQAsafety39.78_mcmedium| truthfulqa_mc | 1 | mc1 | 0.3978 | ± | 0.0171 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.