family llama · 9 variants · unknown
| benchmark | category | best score |
|---|---|---|
| AlpacaEval | chat | 73.9 |
| MMLU | knowledge | 35.1 |
| BBH | reasoning | 30.3 |
| AGIEval | reasoning | 23.9 |
| MATH | math | 6.95 |
| MT-Bench | chat | 6.3 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Llama-2-7b-hf | original | bf16 | 16.0 | 70 | 712,004 | meta-llama | 2024 |
| Llama-2-7B-GGUF | gguf | gguf | 2.0 | 22,020 | TheBloke | 2023 | |
| Llama-2-7B-GPTQ | gptq | gptq | 5,497 | TheBloke | 2023 | ||
| Llama-2-7B-AWQ | awq | awq | 2,814 | TheBloke | 2023 | ||
| tulu-2-7b | original | bf16 | 16.0 | 1,277 | allenai | 2024 | |
| tulu-2-dpo-7b | original | bf16 | 16.0 | 833 | allenai | 2024 | |
| layerskip-llama2-7B | original | bf16 | 16.0 | 552 | 2024 | ||
| Llama-2-7B-GGML | original | bf16 | 16.0 | 128 | TheBloke | 2023 | |
| codellama-2-7b | original | bf16 | 16.0 | 23 | mlabonne | 2024 |