HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Meta-Llama-3.1-8B-Instruct-abliterated

mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated

kind
abliterated
quant
abliterated
family
llama
modality
text-generation
root model
meta-llama/Meta-Llama-3.1-8B-Instruct
provider
mlabonne
license
llama3.1
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
24,003
likes
210
created
—
last modified
2024-09-14T22:17:18+00:00 (2024)
huggingface
https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
tags
transformerssafetensorsllamatext-generationabliterateduncensoredconversationalbase_model:meta-llama/Llama-3.1-8B-Instructbase_model:finetune:meta-llama/Llama-3.1-8B-Instructlicense:llama3.1model-indextext-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
GPQAreasoning89.0GPQA (0-shot)medium| GPQA (0-shot) | 0.89 |
IFEvalinstruction-following73.29IFEval (0-Shot)medium| IFEval (0-Shot) | 73.29 |
MMLU-Proknowledge27.81MMLU-PRO (5-shot)medium| MMLU-PRO (5-shot) | 27.81 |
BBHreasoning27.13BBH (3-Shot)medium| BBH (3-Shot) | 27.13 |
MATHmath6.42MATH Lvl 5 (4-Shot)medium| MATH Lvl 5 (4-Shot) | 6.42 |
MUSRreasoning3.21MuSR (0-shot)medium| MuSR (0-shot) | 3.21 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.