HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-3-270m-it-qat-q4_0-unquantized

google/gemma-3-270m-it-qat-q4_0-unquantized

family gemma · 5 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-3-270m-it-qat-q4_0-unquantized
best scores
HellaSwag: 40.9BoolQ: 61.4PIQA: 67.7TriviaQA: 15.4WinoGrande: 52.0BBH: 26.7IFEval: 80.2GPQA: 19.2SimpleQA: 2.2BigBench: 7.2DROP: 42.4MMLU: 59.6LiveCodeBench: 1.9MATH: 48.0MBPP: 35.2HumanEval: 41.5GSM8K: 62.8AGIEval: 42.1MGSM: 2.04MMMU: 48.8DocVQA: 75.8ChartQA: 68.8MathVista: 50.0

Best scores per benchmark

benchmarkcategorybest score
IFEvalinstruction-following80.2
DocVQAmultimodal75.8
ChartQAmultimodal68.8
PIQAknowledge67.7
GSM8Kmath62.8
BoolQknowledge61.4
MMLUknowledge59.6
WinoGrandeknowledge52.0
MathVistamultimodal50.0
MMMUmultimodal48.8
MATHmath48.0
DROPreasoning42.4
AGIEvalreasoning42.1
HumanEvalcoding41.5
HellaSwagknowledge40.9
MBPPcoding35.2
BBHreasoning26.7
GPQAreasoning19.2
TriviaQAknowledge15.4
BigBenchreasoning7.2
SimpleQAknowledge2.2
MGSMmath2.04
LiveCodeBenchcoding1.9

Variants (5)

variantkindquantbitsvRAMdlorgyear
gemma-3-270m-it-qat-GGUFggufgguf16.03,031unsloth2025
gemma-3-270m-it-qat-MLX-4bitggufgguf1,668lmstudio-community2025
gemma-3-270m-it-qat-GGUFggufgguf4.0759lmstudio-community2025
google_gemma-3-270m-it-qat-GGUFggufgguf3.0577bartowski2025
gemma-3-270m-it-qatggufgguf212unsloth2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.