HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-3.2-3B-Instruct-QLORA_INT4_EO8

meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8

kind
original
quant
bf16 (16-bit)
family
llama
modality
text-generation
root model
meta-llama/Llama-3.2-3B
provider
meta-llama
license
llama3.2
language
en, de, fr, it, pt, hi, es, th
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
78
likes
74
created
—
last modified
2024-11-18T20:32:57+00:00 (2024)
huggingface
https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8
tags
llamafacebookmetapytorchllama-3text-generationendefritpthiestharxiv:2204.05149arxiv:2405.16406base_model:meta-llama/Llama-3.2-3Bbase_model:finetune:meta-llama/Llama-3.2-3Blicense:llama3.2region:us

Benchmark scores (1)

benchmarkcategoryscorecontextconfevidence
MATHmath44.4Mathmedium| Math | | GSM8K (CoT) | 8 | em\_maj1@1 | 44.4 | 33.1 | 40.6 | 46.5 | 77.7 | 72.9 | 75.7 | 77.9 | 84.5 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.