gemma-3-12b-it-qat-int4-GGUF

Home/Models/unsloth/gemma-3-12b-it-qat-int4-GGUF

gemma-3-12b-it-qat-int4-GGUF

unsloth/gemma-3-12b-it-qat-int4-GGUF

kind: gguf
quant: gguf (4-bit)
family: gemma
modality: image-text-to-text
root model: google/gemma-3-12b-it-qat-int4-unquantized
provider: unsloth
license: gemma
language: —
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 2,387
likes: 10
created: —
last modified: 2025-04-23T12:27:03+00:00 (2025)
huggingface: https://huggingface.co/unsloth/gemma-3-12b-it-qat-int4-GGUF
tags: transformersggufgemma3image-text-to-textunslothgemmagooglearxiv:1905.07830arxiv:1905.10044arxiv:1911.11641arxiv:1904.09728arxiv:1705.03551arxiv:1911.01547arxiv:1907.10641arxiv:1903.00161arxiv:2009.03300arxiv:2304.06364arxiv:2103.03874arxiv:2110.14168arxiv:2311.12022arxiv:2108.07732arxiv:2107.03374arxiv:2210.03057arxiv:2106.03193

Benchmark scores (20)

benchmark	category	score	context	conf	evidence
PIQA	knowledge	73.8	[PIQA][]	medium	`\| [PIQA][piqa] \| 0-shot \| 73.8 \| 79.6 \| 81.8 \| 83.3 \|`
DocVQA	multimodal	72.8	[DocVQA][] (val)	medium	`\| [DocVQA][docvqa] (val) \| 72.8 \| 82.3 \| 85.6 \|`
ChartQA	multimodal	63.6	[ChartQA][]	medium	`\| [ChartQA][chartqa] \| 63.6 \| 74.7 \| 76.3 \|`
BoolQ	knowledge	63.2	[BoolQ][]	medium	`\| [BoolQ][boolq] \| 0-shot \| 63.2 \| 72.3 \| 78.8 \| 82.4 \|`
HellaSwag	knowledge	62.3	[HellaSwag][]	medium	`\| [HellaSwag][hellaswag] \| 10-shot \| 62.3 \| 77.2 \| 84.2 \| 85.6 \|`
MMLU	knowledge	59.6	[MMLU][]	medium	`\| [MMLU][mmlu] \| 5-shot \| 59.6 \| 74.5 \| 78.6 \|`
WinoGrande	knowledge	58.2	[WinoGrande][]	medium	`\| [WinoGrande][winogrande] \| 5-shot \| 58.2 \| 64.7 \| 74.3 \| 78.8 \|`
MBPP	coding	46.0	[MBPP][]	medium	`\| [MBPP][mbpp] \| 3-shot \| 46.0 \| 60.4 \| 65.6 \|`
DROP	reasoning	42.4	[DROP][]	medium	`\| [DROP][drop] \| 1-shot \| 42.4 \| 60.1 \| 72.2 \| 77.2 \|`
AGIEval	reasoning	42.1	[AGIEval][]	medium	`\| [AGIEval][agieval] \| 3-5-shot \| 42.1 \| 57.4 \| 66.2 \|`
TriviaQA	knowledge	39.8	[TriviaQA][]	medium	`\| [TriviaQA][triviaqa] \| 5-shot \| 39.8 \| 65.8 \| 78.2 \| 85.5 \|`
MMMU	multimodal	39.2	[MMMU][] (pt)	medium	`\| [MMMU][mmmu] (pt) \| 39.2 \| 50.3 \| 56.1 \|`
GSM8K	math	38.4	[GSM8K][]	medium	`\| [GSM8K][gsm8k] \| 8-shot \| 38.4 \| 71.0 \| 82.6 \|`
HumanEval	coding	36.0	[HumanEval][]	medium	`\| [HumanEval][humaneval] \| 0-shot \| 36.0 \| 45.7 \| 48.8 \|`
MMLU	knowledge	29.2	[MMLU][] (Pro COT)	medium	`\| [MMLU][mmlu] (Pro COT) \| 5-shot \| 29.2 \| 45.3 \| 52.2 \|`
BBH	reasoning	28.4	[BIG-Bench Hard][]	medium	`\| [BIG-Bench Hard][bbh] \| few-shot \| 28.4 \| 50.9 \| 72.6 \| 77.7 \|`
MMLU	knowledge	24.9	[Global-MMLU-Lite][global--lite]	medium	`\| [Global-MMLU-Lite][global-mmlu-lite] \| 24.9 \| 57.0 \| 69.4 \| 75.7 \|`
MATH	math	24.2	[MATH][]	medium	`\| [MATH][math] \| 4-shot \| 24.2 \| 43.3 \| 50.0 \|`
GPQA	reasoning	15.0	[GPQA][]	medium	`\| [GPQA][gpqa] \| 5-shot \| 15.0 \| 25.4 \| 24.3 \|`
MGSM	math	2.04	[MGSM][]	medium	`\| [MGSM][mgsm] \| 2.04 \| 34.7 \| 64.3 \| 74.3 \|`

Discussions (0)

none scraped.