family llama · 6 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-3.1-70B-Instruct | original | bf16 | 16.0 | 1,268,205 | meta-llama | 2024 | |
| Meta-Llama-3.1-70B-Instruct-AWQ-INT4 | awq | awq | 258,512 | hugging-quants | 2024 | ||
| Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 | gptq | gptq | 3,551 | hugging-quants | 2024 | ||
| Llama-3.1-70B-Instruct-GGUF | gguf | gguf | 16.0 | 244 | Mungert | 2025 | |
| Hermes-3-Llama-3.1-70B-bnb-4bit | bnb-4bit | 4bit | 198 | unsloth | 2024 | ||
| Meta-Llama-3.1-70B | original | bf16 | 16.0 | 83 | unsloth | 2024 |