HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

vaultgemma-1b

google/vaultgemma-1b

kind
original
quant
bf16 (16-bit)
family
gemma
modality
text-generation
root model
google/vaultgemma-1b
provider
google
license
gemma
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
3,484
likes
410
created
—
last modified
2025-09-12T15:14:03+00:00 (2025)
huggingface
https://huggingface.co/google/vaultgemma-1b
tags
transformerssafetensorsvaultgemmatext-generationdifferential_privacydp-sgdarxiv:1607.00133arxiv:2411.04205arxiv:2501.18914arxiv:2503.19786arxiv:1905.07830arxiv:1905.10044arxiv:1911.11641arxiv:1904.09728arxiv:1705.03551arxiv:1911.01547license:gemmaendpoints_compatibleregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
PIQAknowledge68.0[PIQA][]medium| [PIQA][piqa] | 0-shot | 68.00 |
BoolQknowledge62.04[BoolQ][]medium| [BoolQ][boolq] | 0-shot | 62.04 |
HellaSwagknowledge39.09[HellaSwag][]medium| [HellaSwag][hellaswag] | 10-shot | 39.09 |
TriviaQAknowledge11.24[TriviaQA][]medium| [TriviaQA][triviaqa] | 5-shot | 11.24 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.