family llama · 5 variants · unknown
| benchmark | category | best score |
|---|---|---|
| MMLU | knowledge | 35.1 |
| BBH | reasoning | 30.3 |
| AGIEval | reasoning | 23.9 |
| MATH | math | 6.95 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-2-13b-chat-hf | original | bf16 | 16.0 | 212,789 | meta-llama | 2024 | |
| Llama-2-13B-chat-GGUF | gguf | gguf | 2.0 | 6,031 | TheBloke | 2023 | |
| Llama-2-13B-chat-GPTQ | gptq | gptq | 696 | TheBloke | 2023 | ||
| Llama-2-13B-chat-AWQ | awq | awq | 368 | TheBloke | 2023 | ||
| Llama-2-13B-chat-GGML | original | bf16 | 16.0 | 139 | TheBloke | 2023 |