HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

jackalope-7B-GGUF

TheBloke/jackalope-7B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
openaccess-ai-collective/jackalope-7b
provider
TheBloke
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
251
likes
7
created
—
last modified
2023-10-11T09:16:17+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/jackalope-7B-GGUF
tags
transformersggufmistraltext-generationendataset:Open-Orca/OpenOrcadataset:LDJnr/LessWrong-Amplify-Instructdataset:LDJnr/Pure-Dovedataset:LDJnr/Verified-Cameldataset:PygmalionAI/PIPPAdataset:meta-math/MetaMathQAdataset:riddle_sensearxiv:2306.02707arxiv:2301.13688base_model:openaccess-ai-collective/jackalope-7bbase_model:quantized:openaccess-ai-collective/jackalope-7blicense:apache-2.0region:us

Benchmark scores (3)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge83.29HellaSwag (10-shot)medium| HellaSwag (10-shot) | 83.29 |
MMLUknowledge63.63MMLU (5-shot)medium| MMLU (5-shot) | 63.63 |
TruthfulQAsafety49.99TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 49.99 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.