family llama · 5 variants · unknown
| benchmark | category | best score |
|---|---|---|
| MMLU | knowledge | 35.1 |
| BBH | reasoning | 30.3 |
| AGIEval | reasoning | 23.9 |
| MATH | math | 6.95 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-2-7b-chat-hf | original | bf16 | 16.0 | 70 | 563,871 | meta-llama | 2024 |
| Llama-2-7B-Chat-GGUF | gguf | gguf | 2.0 | 39,389 | TheBloke | 2023 | |
| Llama-2-7B-Chat-GPTQ | gptq | gptq | 26,548 | TheBloke | 2023 | ||
| Llama-2-7B-Chat-AWQ | awq | awq | 2,406 | TheBloke | 2023 | ||
| Llama-2-7B-Chat-GGML | original | bf16 | 16.0 | 379 | TheBloke | 2023 |