HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Skywork-13B-base-GGUF

TheBloke/Skywork-13B-base-GGUF

kind
gguf
quant
gguf (2-bit)
family
skywork
modality
—
root model
Skywork/Skywork-13B-base
provider
TheBloke
license
other
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
323
likes
6
created
—
last modified
2023-10-31T22:26:05+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Skywork-13B-base-GGUF
tags
transformersggufskyworkarxiv:2310.19341arxiv:2310.16713base_model:Skywork/Skywork-13B-basebase_model:quantized:Skywork/Skywork-13B-baselicense:otherregion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge51.6**MMLU**medium| **MMLU** | 51.6 | 58.0 | 72.5 | 68.8 | - | - | 62.1 |
C-Evalknowledge51.2**C-EVAL**medium| **C-EVAL** | 51.2 | 67.8 | 74.6 | 57.5 | - | 39.4 | 60.6 |
CMMLUknowledge49.5**CMMLU**medium| **CMMLU** | 49.5 | 69.3 | 65.9 | 63.3 | 64.2 | - | 61.8 |
MMLUknowledge46.9low| LLaMA-1-13B-Base | 35.5 | 31.2 | 46.9 | 17.8 |
C-Evalknowledge35.5low| LLaMA-1-13B-Base | 35.5 | 31.2 | 46.9 | 17.8 |
CMMLUknowledge31.2low| LLaMA-1-13B-Base | 35.5 | 31.2 | 46.9 | 17.8 |
GSM8Kmath17.8low| LLaMA-1-13B-Base | 35.5 | 31.2 | 46.9 | 17.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.