HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

juanako-7B-v1-GGUF

TheBloke/juanako-7B-v1-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
fblgit/juanako-7b-v1
provider
TheBloke
license
artistic-2.0
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
148
likes
1
created
—
last modified
2023-11-25T01:33:55+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/juanako-7B-v1-GGUF
tags
transformersggufmistralalignment-handbookgenerated_from_trainerdataset:HuggingFaceH4/ultrafeedback_binarizedbase_model:fblgit/juanako-7b-v1base_model:quantized:fblgit/juanako-7b-v1license:artistic-2.0region:us

Benchmark scores (10)

benchmarkcategoryscorecontextconfevidence
BoolQknowledge83.55medium| boolq | Yaml | none | acc | 0.8355 | ± | 0.0065 |
PIQAknowledge81.94medium| piqa | Yaml | none | acc | 0.8194 | ± | 0.0090 |
WinoGrandeknowledge76.09medium| winogrande | Yaml | none | acc | 0.7609 | ± | 0.0120 |
HellaSwagknowledge65.54medium| hellaswag | Yaml | none | acc | 0.6554 | ± | 0.0047 |
MMLUknowledge60.85medium| mmlu | N/A | none | acc | 0.6085 | ± | 0.1321 |
TruthfulQAsafety58.47- _mc2medium| - truthfulqa_mc2 | Yaml | none | acc | 0.5847 | ± | 0.0153 |
ARC-Challengeknowledge56.91_challengemedium| arc_challenge | Yaml | none | acc | 0.5691 | ± | 0.0145 |
GSM8Kmath45.56medium| gsm8k | Yaml | get-answer | exact_match | 0.4556 | ± | 0.0137 |
TruthfulQAsafety41.98- _mc1medium| - truthfulqa_mc1 | Yaml | none | acc | 0.4198 | ± | 0.0173 |
TruthfulQAsafety26.08medium| truthfulqa | N/A | none | bleu_max | 26.0803 | ± | 0.6528 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.