HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

stablelm-zephyr-3b-GGUF

TheBloke/stablelm-zephyr-3b-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
stabilityai/stablelm-zephyr-3b
provider
TheBloke
license
other
language
en
context
4096,
library
—
vRAM (GB)
—
size on disk
—
downloads
1,025
likes
101
created
—
last modified
2023-12-07T21:06:02+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF
tags
transformersggufstablelmcausal-lmendataset:HuggingFaceH4/ultrachat_200kdataset:HuggingFaceH4/ultrafeedback_binarizeddataset:meta-math/MetaMathQAdataset:WizardLM/WizardLM_evol_instruct_V2_196kdataset:Intel/orca_dpo_pairsarxiv:2305.18290base_model:stabilityai/stablelm-zephyr-3bbase_model:quantized:stabilityai/stablelm-zephyr-3blicense:otherregion:usconversational

Benchmark scores (8)

benchmarkcategoryscorecontextconfevidence
AlpacaEvalchat76.0low| **StableLM Zephyr 3B** 🪁 | 3B | DPO | 6.64 | 76.00 |
HellaSwagknowledge74.2HellaSwag (10-shot)medium| HellaSwag (10-shot) | 74.2 |
WinoGrandeknowledge65.5Winogrande (5-shot)medium| Winogrande (5-shot) | 65.5 |
TruthfulQAsafety46.5TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 46.5 |
MMLUknowledge46.3MMLU (5-shot)medium| MMLU (5-shot) | 46.3 |
GSM8Kmath42.3GSM8K (5-shot)medium| GSM8K (5-shot) | 42.3 |
BigBenchreasoning35.26BigBench (Avg)medium| BigBench (Avg) | 35.26 |
MT-Benchchat6.64low| **StableLM Zephyr 3B** 🪁 | 3B | DPO | 6.64 | 76.00 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.