HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-2b

google/gemma-2b

family gemma · 2 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-2b
best scores
AGIEval: 24.48TruthfulQA: 47.02BigBench: 30.85HellaSwag: 71.36MMLU: 36.3WinoGrande: 65.59GSM8K: 10.69

Best scores per benchmark

benchmarkcategorybest score
HellaSwagknowledge71.36
WinoGrandeknowledge65.59
TruthfulQAsafety47.02
MMLUknowledge36.3
BigBenchreasoning30.85
AGIEvalreasoning24.48
GSM8Kmath10.69

Variants (2)

variantkindquantbitsvRAMdlorgyear
gemma-2b-aps-itoriginalbf1616.0114google2024
Gemmalpaca-2Boriginalbf1616.084mlabonne2024
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.