HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

LUNA-SOLARkrautLM-Instruct-GGUF

TheBloke/LUNA-SOLARkrautLM-Instruct-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
fblgit/LUNA-SOLARkrautLM-Instruct
provider
TheBloke
license
cc-by-nc-4.0
language
en, de
context
4096,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
751
likes
4
created
—
last modified
2023-12-23T13:08:59+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/LUNA-SOLARkrautLM-Instruct-GGUF
tags
transformersggufsolarfinetunedpoInstructaugmentationgermantext-generationendedataset:argilla/distilabel-math-preference-dpobase_model:fblgit/LUNA-SOLARkrautLM-Instructbase_model:quantized:fblgit/LUNA-SOLARkrautLM-Instructlicense:cc-by-nc-4.0region:usconversational

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
TruthfulQAsafety73.68_mc2medium| truthfulqa_mc2 | Yaml | none | 0 | acc | 0.7368 | ± | 0.0149 |
GSM8Kmath64.67medium| gsm8k | Yaml | get-answer | 5 | exact_match | 0.6467 | ± | 0.0132 |
MMLUknowledge64.61medium| mmlu | N/A | none | 0 | acc | 0.6461 | ± | 0.1215 |
ARC-Challengeknowledge25.0_challengemedium| arc_challenge | Yaml | none | 25 | acc | 0.692 | ± | 0.0135 |
HellaSwagknowledge10.0medium| hellaswag | Yaml | none | 10 | acc | 0.7131 | ± | 0.0045 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.