HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

gemma-4-E2B-it

google/gemma-4-E2B-it

kind
original
quant
bf16 (16-bit)
family
gemma
modality
any-to-any
root model
google/gemma-4-E2B
provider
google
license
apache-2.0
language
—
context
128K
library
transformers
vRAM (GB)
—
size on disk
—
downloads
3,856,506
likes
845
created
—
last modified
2026-07-20T16:41:56+00:00 (2026)
huggingface
https://huggingface.co/google/gemma-4-E2B-it
tags
transformerssafetensorsgemma4image-text-to-textany-to-anyarxiv:2607.02770base_model:google/gemma-4-E2Bbase_model:finetune:google/gemma-4-E2Blicense:apache-2.0eval-resultsendpoints_compatibledeploy:azuredeploy:sagemakerregion:us

Benchmark scores (10)

benchmarkcategoryscorecontextconfevidence
AIME 2026math89.2AIME 2026 no toolsmedium| AIME 2026 no tools | 89.2% | 88.3% | 77.5% | 42.5% | 37.5% | 20.8% |
MATHmath85.6MATH-Visionmedium| MATH-Vision | 85.6% | 82.4% | 79.7% | 59.5% | 52.4% | 46.0% |
MMLU-Proknowledge85.2MMLU Promedium| MMLU Pro | 85.2% | 82.6% | 77.2% | 69.4% | 60.0% | 67.6% |
GPQA Diamondreasoning84.3GPQA Diamondmedium| GPQA Diamond | 84.3% | 82.3% | 78.8% | 58.6% | 43.4% | 42.4% |
LiveCodeBenchcoding80.0LiveCodeBench v6medium| LiveCodeBench v6 | 80.0% | 77.1% | 72.0% | 52.0% | 44.0% | 29.1% |
MMMUmultimodal76.9MMMU Promedium| MMMU Pro | 76.9% | 73.8% | 69.1% | 52.6% | 44.2% | 49.7% |
BigBenchreasoning74.4BigBench Extra Hardmedium| BigBench Extra Hard | 74.4% | 64.8% | 53.0% | 33.1% | 21.9% | 19.3% |
Humanity's Last Examknowledge26.5HLE with searchmedium| HLE with search | 26.5% | 17.2% | - | - | - | - |
Humanity's Last Examknowledge19.5HLE no toolsmedium| HLE no tools | 19.5% | 8.7% | 5.2% | - | - | - |
WER FLEURSspeech-asr8.0FLEURS (lower is better)medium| FLEURS (lower is better) | - | - | 0.069<sup>*</sup> | 0.08 | 0.09 | - |

Discussions (43)

titleauthorstatuscommentstype
Update chat_template.jinjaAlexHung29629closed0disc
Update READMEMaartenGrmerged0disc
Raise per-image vision soft-token budget from 280 to 1120lucianommartinsopen0disc
Add response_template to tokenizer_config.jsonRocketknight1merged0disc
Add IFStruct v1.0 evaluation resultSaylorTwiftopen0disc
Add Vaani-Benchmark-V1.0 eval resultsPranavdbhatArtparkopen0disc
Appreciation PostMaaniclosed0disc
Chat template may re-inject prior-turn reasoning during multi-turn tool use → repetition loopsManniX-ITAopen0disc
fix: chat template — null handling, reasoning preservation, turn-tag balance, input validationlucianommartinsmerged0disc
Add EvalEval community eval resultsEvalEvalBotclosed0disc
fun configbaseten-adminopen0disc
Add MMMU-Pro evaluation resultSaylorTwiftopen0disc
Fix lineageosansevieromerged0disc
How to best prompt for transcription results when sending audio input?DiffusionFanatic1open0disc
GGUF + pure-C++ runtime in CrispASR — Gemma-4-E2B (ASR)cstropen0disc
fix(chat_template): Emit multimodal placeholders in tool response content-partsharshaljanjanimerged0disc
[Feature request] Eliminate pre-attention RMSNorm in Gemma 4 via scale invariance + weight foldinggraeficsopen0disc
fix(chat_template): update SI and tool call handlingdougreidmerged0disc
fix(chat template): better SI and tool call handlingdougreiddraft0disc
[Bug] Chat template redacting reasoning traces for non-tool related use casevibhas09open0disc
Why k/v proj exist in layers where "is_kv_shared_layer = True"?jiayuanmopen0disc
Issue loading google/gemma-4-E2B-it with AutoProcessor (Unrecognized processing class)dipakmeher51open0disc
Error loading Gemma 4 from official notebookmelvindaveclosed0disc
regarding of supported image token budgetsJ22open0disc
Request: DOIHoumanAlclosed0disc
Update README.mdHighgroundbkkopen0disc
Litert version after fine-tuningAbhijitmoreopen0disc
Welcome G4! Any new T5-G4 coming?iSurpriseMeopen0disc
Update response schemaRocketknight1merged0disc
Requestmlboydaisukeopen0disc
fix: prefix-preserving tool calls + dialog compliancelucianommartinsmerged0disc
fix: function calling formatting in chat templateRyanMullinsopen0disc
Update README.mdTialynnsitzclosed0disc
Allucination parsing JSON responses containing numerical data such as 1234.00jeisonvendettaopen0disc
Benchmarking low resource languagesindiaiquestopen0disc
Embed chat_template in tokenizer_config.jsonpiero-atelicoopen0disc
Embed chat_template in tokenizer_config.jsonpiero-atelicoclosed0disc
Issue with llama.cppkelkalotclosed0disc
Welcome G4! Any new T5-G4 coming?JohnGeneticaopen0disc
Add AIME 2026 evaluation resultSaylorTwiftopen0disc
ordl-gemma-familyWinsocketclosed0disc
Upload 2 filesmerveopen0disc
Proposed video configurationpcuenqmerged0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.