HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

gemma-2-9b-it-AWQ-INT4

hugging-quants/gemma-2-9b-it-AWQ-INT4

kind
awq
quant
awq
family
gemma
modality
text-generation
root model
google/gemma-2-9b-it
provider
hugging-quants
license
gemma
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
283,782
likes
9
created
—
last modified
2024-10-17T08:31:37+00:00 (2024)
huggingface
https://huggingface.co/hugging-quants/gemma-2-9b-it-AWQ-INT4
tags
transformerssafetensorsgemma2text-generationgoogleautoawqconversationalenbase_model:google/gemma-2-9b-itbase_model:quantized:google/gemma-2-9b-itlicense:gemmatext-generation-inferenceendpoints_compatible4-bitawqregion:usdeploy:azure

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.