HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

SUS-Chat-34B-GGUF

TheBloke/SUS-Chat-34B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
SUSTech/SUS-Chat-34B
provider
TheBloke
license
other
language
—
context
8192,
library
—
vRAM (GB)
—
size on disk
—
downloads
380
likes
15
created
—
last modified
2023-12-05T18:47:42+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/SUS-Chat-34B-GGUF
tags
transformersggufyitext-generationbase_model:SUSTech/SUS-Chat-34Bbase_model:quantized:SUSTech/SUS-Chat-34Blicense:otherregion:us

Benchmark scores (9)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge83.79high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
C-Evalknowledge82.42high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
WinoGrandeknowledge81.22high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
GSM8Kmath80.06high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
CMMLUknowledge78.68high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
MMLUknowledge77.35high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
BBHreasoning67.62high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
TruthfulQAsafety57.47high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |
MATHmath28.8high| SUS-Chat-34B | 77.35 | 78.68 | 82.42 | 80.06 | 67.62 | 28.8 | 81.22 | 81.54 | 83.79 | 57.47 | 71.895 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.