HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

UNA-TheBeagle-7B-v1-GGUF

TheBloke/UNA-TheBeagle-7B-v1-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
fblgit/UNA-TheBeagle-7b-v1
provider
TheBloke
license
cc-by-nc-nd-4.0
language
—
context
32768,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
382
likes
20
created
—
last modified
2024-01-12T18:27:59+00:00 (2024)
huggingface
https://huggingface.co/TheBloke/UNA-TheBeagle-7B-v1-GGUF
tags
transformersggufmistralgenerated_from_trainerdataset:jondurbin/bagel-v0.3base_model:fblgit/UNA-TheBeagle-7b-v1base_model:quantized:fblgit/UNA-TheBeagle-7b-v1license:cc-by-nc-nd-4.0region:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
WinoGrandeknowledge83.66medium| winogrande | Yaml | none | 5 | acc | 0.8366 | ± | 0.0104 |
GSM8Kmath72.1medium| gsm8k | Yaml | get-answer | 5 | exact_match | 0.7210 | ± | 0.0124 |
TruthfulQAsafety70.62_mc2medium| truthfulqa_mc2 | Yaml | none | 0 | acc | 0.7062 | ± | 0.0151 |
ARC-Challengeknowledge25.0_challengemedium| arc_challenge | Yaml | none | 25 | acc | 0.7090 | ± | 0.0133 |
HellaSwagknowledge10.0medium| hellaswag | Yaml | none | 10 | acc | 0.7202 | ± | 0.0045 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.