HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/diffusiongemma-26B-A4B-it

google/diffusiongemma-26B-A4B-it

family gemma · 4 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/diffusiongemma-26B-A4B-it
best scores
MMLU-Pro: 81.0AIME 2026: 69.1LiveCodeBench: 69.1GPQA Diamond: 73.2Humanity's Last Exam: 11.9BigBench: 47.6MMMU: 54.3MATH: 70.5AIME 2025: 68.33GSM8K: 94.54IFEval: 94.01HumanEval: 94.09

Best scores per benchmark

benchmarkcategorybest score
GSM8Kmath94.54
HumanEvalcoding94.09
IFEvalinstruction-following94.01
MMLU-Proknowledge81.0
GPQA Diamondreasoning73.2
MATHmath70.5
AIME 2026math69.1
LiveCodeBenchcoding69.1
AIME 2025math68.33
MMMUmultimodal54.3
BigBenchreasoning47.6
Humanity's Last Examknowledge11.9

Variants (4)

variantkindquantbitsvRAMdlorgyear
diffusiongemma-26B-A4B-itoriginalbf1616.01,871,257google2026
diffusiongemma-26B-A4B-it-NVFP4nvfp4nvfp44.01,736,406nvidia2026
diffusiongemma-26B-A4B-it-GGUFggufgguf16.070,614unsloth2026
diffusiongemma-26B-A4B-itoriginalbf1616.09,910unsloth2026
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.