HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-3.2-3B-Instruct-Q4_K_M-GGUF

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

kind
gguf
quant
gguf (4-bit)
family
llama
modality
text-generation
root model
meta-llama/Llama-3.2-3B-Instruct
provider
hugging-quants
license
—
language
en, de, fr, it, pt, hi, es, th
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
23,295
likes
35
created
—
last modified
2024-09-25T16:12:08+00:00 (2024)
huggingface
https://huggingface.co/hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationendefritpthiesthbase_model:meta-llama/Llama-3.2-3B-Instructbase_model:quantized:meta-llama/Llama-3.2-3B-Instructendpoints_compatibleregion:usconversational

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.