HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

WizardLM-2-8x22B

alpindale/WizardLM-2-8x22B

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
—
provider
alpindale
license
apache-2.0
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
9,618
likes
415
created
—
last modified
2024-09-14T15:51:22+00:00 (2024)
huggingface
https://huggingface.co/alpindale/WizardLM-2-8x22B
tags
transformerssafetensorsmixtraltext-generationconversationalarxiv:2304.12244arxiv:2306.08568arxiv:2308.09583license:apache-2.0model-indextext-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
IFEvalinstruction-following52.72IFEval (0-Shot)medium| IFEval (0-Shot) | 52.72 |
BBHreasoning48.58BBH (3-Shot)medium| BBH (3-Shot) | 48.58 |
MMLU-Proknowledge39.96MMLU-PRO (5-shot)medium| MMLU-PRO (5-shot) | 39.96 |
MATHmath22.28MATH Lvl 5 (4-Shot)medium| MATH Lvl 5 (4-Shot) | 22.28 |
GPQAreasoning17.56GPQA (0-shot)medium| GPQA (0-shot) | 17.56 |
MUSRreasoning14.54MuSR (0-shot)medium| MuSR (0-shot) | 14.54 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.