HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Gemma-4-31B-IT-NVFP4

nvidia/Gemma-4-31B-IT-NVFP4

kind
nvfp4
quant
nvfp4 (4-bit)
family
gemma
modality
text-generation
root model
google/gemma-4-31B-it
provider
nvidia
license
other
language
—
context
—
library
Model Optimizer
vRAM (GB)
—
size on disk
—
downloads
2,707,994
likes
545
created
—
last modified
2026-07-13T22:33:54+00:00 (2026)
huggingface
https://huggingface.co/nvidia/Gemma-4-31B-IT-NVFP4
tags
Model Optimizersafetensorsgemma4nvidiaModelOptGemma-4-31B-ITlighthousequantizedNVFP4text-generationconversationalbase_model:google/gemma-4-31B-itbase_model:quantized:google/gemma-4-31B-itlicense:othermodeloptdeploy:azureregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
AIME 2025math87.92AIME 2025medium| AIME 2025 | 87.92% | 87.60% |
GPQA Diamondreasoning85.8GPQA Diamondmedium| GPQA Diamond | 85.80% | 85.35% |
MMLU-Proknowledge85.25MMLU Promedium| MMLU Pro | 85.25% | 84.94% |
LiveCodeBenchcoding82.49LiveCodeBench (pass@1)medium| LiveCodeBench (pass@1) | 82.49% | 82.27% |
SciCodecoding33.61Scicode subtask acc (pass@1)medium| Scicode subtask acc (pass@1) | 33.61% | 33.18% |
Terminal-Benchagentic-coding27.08Terminal-Bench Hard (pass@1)medium| Terminal-Bench Hard (pass@1) | 27.08% | 27.08% |

Discussions (16)

titleauthorstatuscommentstype
Update chat_template.jinjaxdavxdclosed0disc
fix(chat_template): backport latest Google canonical templatetaniguchimasayaopen0disc
Model tree shows "Finetuned" instead of "Quantized"gaku-gakuopen0disc
How to run this model YAML with sparkrun on NVIDIA GB10Sunnypangopen0disc
Update tokenizer_config.jsonzhiyuchengmerged0disc
Update chat_template.jinjazhiyuchengmerged0disc
Update README.mdtstarkey-nvidiamerged0disc
Request: DOIbrayden-petersonclosed0disc
This model wasn't trained with FP4 or NVFP4yangus87open0disc
1*H100 with vLLM 0.19.0 FailedJeffreyShengopen0disc
Question about q_scale / KV cache scale fallback in vLLM for Gemma-4-31B-IT-NVFP4: expected accuracy impact?Shaoqingopen0disc
Why not quantize the MATRICES of Wq, Wk, Wv, Wo?BeetSoupopen0disc
这个版本对于5090单卡来说还是太大了iwaituopen0disc
Why is this 4bit version has a 32.7 GB size?alexcardoopen0disc
Inference on single RTX5090?SyferOclosed0disc
Update README.mdtstarkey-nvidiaclosed0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.