family llama · 6 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-3.1-405B-Instruct | original | bf16 | 16.0 | 111,259 | meta-llama | 2024 | |
| Meta-Llama-3.1-405B-Instruct-AWQ-INT4 | awq | awq | 1,216 | hugging-quants | 2024 | ||
| Meta-Llama-3.1-405B-bnb-4bit | bnb-4bit | 4bit | 464 | unsloth | 2024 | ||
| Meta-Llama-3.1-405B-BNB-NF4-BF16 | bnb-4bit | 4bit | 144 | hugging-quants | 2024 | ||
| Meta-Llama-3.1-405B-Instruct-GPTQ-INT4 | gptq | gptq | 137 | hugging-quants | 2024 | ||
| Meta-Llama-3.1-405B-Instruct-bnb-4bit | bnb-4bit | 4bit | 121 | unsloth | 2024 |