family llama · 5 variants · unknown
| benchmark | category | best score |
|---|---|---|
| AlpacaEval | chat | 73.9 |
| MMLU | knowledge | 35.1 |
| BBH | reasoning | 30.3 |
| AGIEval | reasoning | 23.9 |
| MATH | math | 6.95 |
| MT-Bench | chat | 6.3 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-2-70b-hf | original | bf16 | 16.0 | 6,129 | meta-llama | 2024 | |
| Llama-2-70B-AWQ | awq | awq | 5,263 | TheBloke | 2023 | ||
| Llama-2-70B-GGUF | gguf | gguf | 2.0 | 840 | TheBloke | 2023 | |
| Llama-2-70B-GPTQ | gptq | gptq | 506 | TheBloke | 2023 | ||
| tulu-2-dpo-70b | original | bf16 | 16.0 | 248 | allenai | 2024 |