HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Trurl-2-7B-GGUF

TheBloke/Trurl-2-7B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
Voicelab/trurl-2-7b
provider
TheBloke
license
llama2
language
en, pl
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
168
likes
5
created
—
last modified
2023-09-27T12:48:14+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Trurl-2-7B-GGUF
tags
transformersggufllamavoicelabpytorchllama-2trurltrurl-2text-generationenplbase_model:Voicelab/trurl-2-7bbase_model:quantized:Voicelab/trurl-2-7blicense:llama2region:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge80.09Trurl 2.0 (with MMLU)medium| Trurl 2.0 (with MMLU) | 13B | 80.09% | 59.30% | 78.35% |
HellaSwagknowledge78.55low| Llama-2-chat | 7B | 78.55% | 52.9% | 48.32% |
MMLUknowledge75.29Trurl 2.0 (no MMLU)medium| Trurl 2.0 (no MMLU) | 7b | 75.29% | 53.41% | 50.0% |
ARC-Challengeknowledge52.9low| Llama-2-chat | 7B | 78.55% | 52.9% | 48.32% |
MMLUknowledge48.32low| Llama-2-chat | 7B | 78.55% | 52.9% | 48.32% |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.