HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-3-1b-pt

google/gemma-3-1b-pt

family gemma · 6 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-3-1b-pt
best scores
HellaSwag: 62.3BoolQ: 63.2PIQA: 73.8TriviaQA: 39.8WinoGrande: 58.2BBH: 28.4DROP: 42.4MMLU: 59.6AGIEval: 42.1MATH: 24.2GSM8K: 38.4GPQA: 15.0MBPP: 46.0HumanEval: 36.0MGSM: 2.04DocVQA: 72.8MMMU: 39.2ChartQA: 63.6

Best scores per benchmark

benchmarkcategorybest score
PIQAknowledge73.8
DocVQAmultimodal72.8
ChartQAmultimodal63.6
BoolQknowledge63.2
HellaSwagknowledge62.3
MMLUknowledge59.6
WinoGrandeknowledge58.2
MBPPcoding46.0
DROPreasoning42.4
AGIEvalreasoning42.1
TriviaQAknowledge39.8
MMMUmultimodal39.2
GSM8Kmath38.4
HumanEvalcoding36.0
BBHreasoning28.4
MATHmath24.2
GPQAreasoning15.0
MGSMmath2.04

Variants (6)

variantkindquantbitsvRAMdlorgyear
gemma-3-1b-itoriginalbf1616.03,187,943google2025
gemma-3-1b-ptoriginalbf1616.053,504google2025
gemma-3-1b-ptoriginalbf1616.04,332unsloth2025
gemma-3-1b-pt-i1-GGUFggufgguf1.0982mradermacher2025
gemma-3-1b-pt-unsloth-bnb-4bitbnb-4bit4bit665unsloth2025
gemma-3-1b-pt-bnb-4bitbnb-4bit4bit188unsloth2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.