family qwen · 3 variants · unknown
| benchmark | category | best score |
|---|---|---|
| HellaSwag | knowledge | 87.1 |
| CMMLU | knowledge | 84.8 |
| C-Eval | knowledge | 83.5 |
| WinoGrande | knowledge | 82.5 |
| MMLU | knowledge | 71.4 |
| GSM8K | math | 65.7 |
| MBPP | coding | 63.9 |
| EvalPlus | coding | 48.5 |
| TruthfulQA | safety | 46.4 |
| BBH | reasoning | 45.4 |
| HumanEval | coding | 45.1 |
| MMLU-Pro | knowledge | 43.3 |
| GPQA | reasoning | 30.8 |
| MATH | math | 30.8 |
| LiveCodeBench | coding | 12.3 |
| MT-Bench | chat | 8.3 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Qwen2-57B-A14B-Instruct | original | bf16 | 16.0 | 16,868 | Qwen | 2024 | |
| Qwen2-57B-A14B | original | bf16 | 16.0 | 10,141 | Qwen | 2024 | |
| Qwen2-57B-A14B-Instruct-GGUF | gguf | gguf | 1,443 | Qwen | 2024 |