google/gemma-4-E4B-it-qat-q4_0-unquantized
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| AIME 2026 | math | 89.2 | AIME 2026 no tools | medium | | AIME 2026 no tools | 89.2% | 88.3% | 77.5% | 42.5% | 37.5% | 20.8% | |
| MATH | math | 85.6 | MATH-Vision | medium | | MATH-Vision | 85.6% | 82.4% | 79.7% | 59.5% | 52.4% | 46.0% | |
| MMLU-Pro | knowledge | 85.2 | MMLU Pro | medium | | MMLU Pro | 85.2% | 82.6% | 77.2% | 69.4% | 60.0% | 67.6% | |
| GPQA Diamond | reasoning | 84.3 | GPQA Diamond | medium | | GPQA Diamond | 84.3% | 82.3% | 78.8% | 58.6% | 43.4% | 42.4% | |
| LiveCodeBench | coding | 80.0 | LiveCodeBench v6 | medium | | LiveCodeBench v6 | 80.0% | 77.1% | 72.0% | 52.0% | 44.0% | 29.1% | |
| MMMU | multimodal | 76.9 | MMMU Pro | medium | | MMMU Pro | 76.9% | 73.8% | 69.1% | 52.6% | 44.2% | 49.7% | |
| BigBench | reasoning | 74.4 | BigBench Extra Hard | medium | | BigBench Extra Hard | 74.4% | 64.8% | 53.0% | 33.1% | 21.9% | 19.3% | |
| Humanity's Last Exam | knowledge | 26.5 | HLE with search | medium | | HLE with search | 26.5% | 17.2% | - | - | - | - | |
| Humanity's Last Exam | knowledge | 19.5 | HLE no tools | medium | | HLE no tools | 19.5% | 8.7% | 5.2% | - | - | - | |
| WER FLEURS | speech-asr | 8.0 | FLEURS (lower is better) | medium | | FLEURS (lower is better) | - | - | 0.069<sup>*</sup> | 0.08 | 0.09 | - | |
none scraped.