HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

google/gemma-3-12b-pt

family gemma · 7 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-3-12b-pt
best scores
HellaSwag: 62.3BoolQ: 63.2PIQA: 73.8TriviaQA: 39.8WinoGrande: 58.2BBH: 28.4DROP: 42.4MMLU: 59.6AGIEval: 42.1MATH: 24.2GSM8K: 38.4GPQA: 15.0MBPP: 46.0HumanEval: 36.0MGSM: 2.04DocVQA: 72.8MMMU: 39.2ChartQA: 63.6

Best scores per benchmark

benchmarkcategorybest score

Variants (7)

variantkindquantbitsvRAMdlorgyear
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.