HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/google/google/gemma-7b-it-quant-pytorch

google/gemma-7b-it-quant-pytorch

family gemma · 12 variants · unknown

provider
google
released
—
huggingface
https://huggingface.co/google/gemma-7b-it-quant-pytorch
best scores
MMLU: 42.3HellaSwag: 71.4PIQA: 77.3WinoGrande: 65.4CommonsenseQA: 65.3OpenBookQA: 47.8TriviaQA: 53.2HumanEval: 22.0MBPP: 29.2GSM8K: 17.7MATH: 11.8AGIEval: 24.2BigBench: 35.2TruthfulQA: 44.84

Best scores per benchmark

benchmarkcategorybest score
PIQAknowledge77.3
HellaSwagknowledge71.4
WinoGrandeknowledge65.4
CommonsenseQAknowledge65.3
TriviaQAknowledge53.2
OpenBookQAknowledge47.8
TruthfulQAsafety44.84
MMLUknowledge42.3
BigBenchreasoning35.2
MBPPcoding29.2
AGIEvalreasoning24.2
HumanEvalcoding22.0
GSM8Kmath17.7
MATHmath11.8

Variants (12)

variantkindquantbitsvRAMdlorgyear
gemma-7bggufgguf29,394google2024
gemma-7b-itoriginalbf1616.017,434unsloth2024
gemma-7b-bnb-4bitbnb-4bit4bit1,757unsloth2025
gemma-7b-it-bnb-4bitbnb-4bit4bit903unsloth2024
gemma-7boriginalbf1616.0725unsloth2025
gemma-7boriginalbf1616.0350alpindale2024
gemma-7b-it-GGUFggufgguf2.0334mlabonne2024
gemma-7b-GGUFggufgguf2.0140mlabonne2024
gemma-7b-AWQawqawq72google2024
gemma-7b-itoriginalbf1616.068alpindale2024
gemma-7b-it-quant-pytorchoriginalbf1616.064google2024
gemma-7b-GGUFggufgguf54google2024
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.