HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-3-27b-pt

google/gemma-3-27b-pt

family gemma · 8 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-3-27b-pt
best scores
HellaSwag: 62.3BoolQ: 63.2PIQA: 73.8TriviaQA: 39.8WinoGrande: 58.2BBH: 28.4DROP: 42.4MMLU: 87.0AGIEval: 42.1MATH: 24.2GSM8K: 38.4GPQA: 15.0MBPP: 46.0HumanEval: 36.0MGSM: 2.04DocVQA: 72.8MMMU: 39.2ChartQA: 63.6MedQA: 74.9

Best scores per benchmark

benchmarkcategorybest score
MMLUknowledge87.0
MedQAdomain74.9
PIQAknowledge73.8
DocVQAmultimodal72.8
ChartQAmultimodal63.6
BoolQknowledge63.2
HellaSwagknowledge62.3
WinoGrandeknowledge58.2
MBPPcoding46.0
DROPreasoning42.4
AGIEvalreasoning42.1
TriviaQAknowledge39.8
MMMUmultimodal39.2
GSM8Kmath38.4
HumanEvalcoding36.0
BBHreasoning28.4
MATHmath24.2
GPQAreasoning15.0
MGSMmath2.04

Variants (8)

variantkindquantbitsvRAMdlorgyear
gemma-3-27b-itoriginalbf1616.0851,300google2025
medgemma-27b-itoriginalbf1616.0118,825google2025
medgemma-27b-text-itoriginalbf1616.030,027google2025
gemma-3-27b-ptoriginalbf1616.09,685google2025
gemma-3-27b-it-GGUFggufgguf16.0332Mungert2025
medgemma-27b-text-it-GGUFggufgguf16.0259Mungert2025
gemma-3-27b-ptoriginalbf1616.0182unsloth2025
gemma-3-27b-pt-bnb-4bitbnb-4bit4bit135unsloth2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.