HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-4-12B-it-assistant

google/gemma-4-12B-it-assistant

family gemma · 2 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-4-12B-it-assistant
best scores
MMLU-Pro: 85.2AIME 2026: 89.2LiveCodeBench: 80.0GPQA Diamond: 84.3Humanity's Last Exam: 26.5BigBench: 74.4MMMU: 76.9MATH: 85.6WER FLEURS: 8.0

Best scores per benchmark

benchmarkcategorybest score
AIME 2026math89.2
MATHmath85.6
MMLU-Proknowledge85.2
GPQA Diamondreasoning84.3
LiveCodeBenchcoding80.0
MMMUmultimodal76.9
BigBenchreasoning74.4
Humanity's Last Examknowledge26.5
WER FLEURSspeech-asr8.0

Variants (2)

variantkindquantbitsvRAMdlorgyear
gemma-4-12B-it-assistantoriginalbf1616.0124,235google2026
gemma-4-12B-it-qat-q4_0-unquantized-assistantggufgguf101,679google2026
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.