family gemma · 1 variants · unknown
| benchmark | category | best score |
|---|---|---|
| PIQA | knowledge | 66.5 |
| BoolQ | knowledge | 57.4 |
| RULER | long-context | 57.3 |
| WinoGrande | knowledge | 53.9 |
| DocVQA | multimodal | 41.6 |
| HellaSwag | knowledge | 41.1 |
| DROP | reasoning | 39.4 |
| ChartQA | multimodal | 29.2 |
| MMLU | knowledge | 23.5 |
| BBH | reasoning | 22.9 |
| MMMU | multimodal | 22.7 |
| AGIEval | reasoning | 20.9 |
| TriviaQA | knowledge | 14.8 |
| GPQA | reasoning | 9.6 |
| MBPP | coding | 5.6 |
| HumanEval | coding | 4.3 |
| MGSM | math | 1.8 |
| GSM8K | math | 1.7 |
| MATH | math | 1.5 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| t5gemma-2-4b-4b | original | bf16 | 16.0 | 26,179 | 2025 |