HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-2-9b

google/gemma-2-9b

family gemma · 3 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-2-9b
best scores
MMLU: 71.3HellaSwag: 81.9PIQA: 81.7BoolQ: 84.2WinoGrande: 80.6TriviaQA: 76.6HumanEval: 40.2MBPP: 52.4GSM8K: 68.6MATH: 36.6AGIEval: 52.8BigBench: 68.2TruthfulQA: 50.27

Best scores per benchmark

benchmarkcategorybest score
BoolQknowledge84.2
HellaSwagknowledge81.9
PIQAknowledge81.7
WinoGrandeknowledge80.6
TriviaQAknowledge76.6
MMLUknowledge71.3
GSM8Kmath68.6
BigBenchreasoning68.2
AGIEvalreasoning52.8
MBPPcoding52.4
TruthfulQAsafety50.27
HumanEvalcoding40.2
MATHmath36.6

Variants (3)

variantkindquantbitsvRAMdlorgyear
gemma-2-9b-itoriginalbf1616.0318,409google2024
gemma-2-9boriginalbf1616.098,837google2024
gemma-2-9b-bnb-4bitbnb-4bit4bit10,436unsloth2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.