HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

NeuralDarewin-7B

mlabonne/NeuralDarewin-7B

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
mistralai/Mistral-7B-v0.1
provider
mlabonne
license
apache-2.0
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
61
likes
4
created
—
last modified
2024-03-04T15:15:19+00:00 (2024)
huggingface
https://huggingface.co/mlabonne/NeuralDarewin-7B
tags
transformerssafetensorsmistraltext-generationlicense:apache-2.0model-indextext-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge86.4HellaSwag (10-Shot)medium| HellaSwag (10-Shot) | 86.40 |
WinoGrandeknowledge79.72Winogrande (5-shot)medium| Winogrande (5-shot) | 79.72 |
GSM8Kmath66.72GSM8k (5-shot)medium| GSM8k (5-shot) | 66.72 |
MMLUknowledge64.85MMLU (5-Shot)medium| MMLU (5-Shot) | 64.85 |
TruthfulQAsafety62.92TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 62.92 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.