HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

SauerkrautLM-SOLAR-Instruct-GGUF

TheBloke/SauerkrautLM-SOLAR-Instruct-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
VAGOsolutions/SauerkrautLM-SOLAR-Instruct
provider
TheBloke
license
cc-by-nc-4.0
language
en, de
context
8192,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
403
likes
2
created
—
last modified
2023-12-23T10:05:06+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/SauerkrautLM-SOLAR-Instruct-GGUF
tags
transformersggufsolarfinetunedpoInstructaugmentationgermantext-generationendedataset:argilla/distilabel-math-preference-dpobase_model:VAGOsolutions/SauerkrautLM-SOLAR-Instructbase_model:quantized:VAGOsolutions/SauerkrautLM-SOLAR-Instructlicense:cc-by-nc-4.0region:usconversational

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge88.63HellaSwag (10-shot)medium| HellaSwag (10-shot) | 88.63 |
WinoGrandeknowledge83.5Winogrande (5-shot)medium| Winogrande (5-shot) | 83.5 |
TruthfulQAsafety71.95TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 71.95 |
MMLUknowledge66.2MMLU (5-shot)medium| MMLU (5-shot) | 66.2 |
GSM8Kmath64.14GSM8K (5-shot)medium| GSM8K (5-shot) | 64.14 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.