HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-3-4b-pt

google/gemma-3-4b-pt

family gemma · 10 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-3-4b-pt
best scores
HellaSwag: 62.3BoolQ: 63.2PIQA: 73.8TriviaQA: 39.8WinoGrande: 58.2BBH: 28.4DROP: 42.4MMLU: 87.0AGIEval: 42.1MATH: 24.2GSM8K: 38.4GPQA: 15.0MBPP: 46.0HumanEval: 36.0MGSM: 2.04DocVQA: 72.8MMMU: 39.2ChartQA: 63.6MedQA: 74.9

Best scores per benchmark

benchmarkcategorybest score
MMLUknowledge87.0
MedQAdomain74.9
PIQAknowledge73.8
DocVQAmultimodal72.8
ChartQAmultimodal63.6
BoolQknowledge63.2
HellaSwagknowledge62.3
WinoGrandeknowledge58.2
MBPPcoding46.0
DROPreasoning42.4
AGIEvalreasoning42.1
TriviaQAknowledge39.8
MMMUmultimodal39.2
GSM8Kmath38.4
HumanEvalcoding36.0
BBHreasoning28.4
MATHmath24.2
GPQAreasoning15.0
MGSMmath2.04

Variants (10)

variantkindquantbitsvRAMdlorgyear
gemma-3-4b-itoriginalbf1616.02,093,730google2025
gemma-3-4b-ptoriginalbf1616.063,380google2025
gemma-3-4b-ptoriginalbf1616.011,104unsloth2025
shieldgemma-2-4b-itoriginalbf1616.06,707google2025
gemma-3-4b-pt-bnb-4bitbnb-4bit4bit1,945unsloth2025
medgemma-4b-ptoriginalbf1616.01,560google2025
gemma-3-4b-pt-unsloth-bnb-4bitbnb-4bit4bit999unsloth2025
Gemma-3-Gaia-PT-BR-4b-it-GGUFggufgguf16.0235Mungert2025
medgemma-4b-pt-GGUFggufgguf16.0205Mungert2025
gemma-3-4b-pt-qat-q4_0-ggufggufgguf4.050google2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.