HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUF

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUF

kind
gguf
quant
gguf (2-bit)
family
llama
modality
—
root model
harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k
provider
TheBloke
license
apache-2.0
language
en
context
2048,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
1,078
likes
12
created
—
last modified
2023-11-30T00:07:02+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GGUF
tags
transformersggufllamaendataset:WizardLM/WizardLM_evol_instruct_V2_196kbase_model:harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196kbase_model:quantized:harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196klicense:apache-2.0region:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge73.01HellaSwag (10-shot)medium| HellaSwag (10-shot) | 73.01 |
WinoGrandeknowledge66.69Winogrande (5-shot)medium| Winogrande (5-shot) | 66.69 |
TruthfulQAsafety38.99TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 38.99 |
MMLUknowledge26.36MMLU (5-shot)medium| MMLU (5-shot) | 26.36 |
DROPreasoning5.57DROP (3-shot)medium| DROP (3-shot) | 5.57 |
GSM8Kmath1.9GSM8K (5-shot)medium| GSM8K (5-shot) | 1.9 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.