HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

UNAversal-8x7B-v1beta-GGUF

TheBloke/UNAversal-8x7B-v1beta-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
fblgit/UNAversal-8x7B-v1beta
provider
TheBloke
license
cc-by-nc-sa-4.0
language
en
context
32768,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
167
likes
1
created
—
last modified
2023-12-30T17:22:29+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/UNAversal-8x7B-v1beta-GGUF
tags
transformersggufmixtralUNAjuanakoMoEenbase_model:fblgit/UNAversal-8x7B-v1betabase_model:quantized:fblgit/UNAversal-8x7B-v1betalicense:cc-by-nc-sa-4.0region:usconversational

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
BoolQknowledge86.24medium| boolq | Yaml | none | 0 | acc | 0.8624 | ± | 0.0060 |
PIQAknowledge82.92medium| piqa | Yaml | none | 0 | acc | 0.8292 | ± | 0.0088 |
TruthfulQAsafety71.22_mc2medium| truthfulqa_mc2 | Yaml | none | 0 | acc | 0.7122 | ± | 0.0141 |
BBHreasoning67.52medium| bbh | N/A | get-answer | 0 | exact_match | 0.6752 | ± | 0.1772 |
GSM8Kmath66.03medium| gsm8k | Yaml | get-answer | 5 | exact_match | 0.6603 | ± | 0.013 |
ARC-Challengeknowledge25.0_challengemedium| arc_challenge | Yaml | none | 25 | acc | 0.6621 | ± | 0.0138 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.