family yi · 4 variants · unknown
| benchmark | category | best score |
|---|---|---|
| CMMLU | knowledge | 75.5 |
| GAOKAO | knowledge | 72.2 |
| C-Eval | knowledge | 72.0 |
| MMLU | knowledge | 63.2 |
| BBH | reasoning | 42.8 |
| MATH | math | 19.8 |
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Yi-6B | original | bf16 | 16.0 | 15,052 | 01-ai | 2024 | |
| Yi-6B-GGUF | gguf | gguf | 2.0 | 335 | TheBloke | 2023 | |
| Yi-6B-Chat-4bits | awq | awq | 108 | 01-ai | 2024 | ||
| Yi-6B-Chat-8bits | gptq | gptq | 99 | 01-ai | 2024 |