HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Yi-34B-GGUF

TheBloke/Yi-34B-GGUF

kind
gguf
quant
gguf (2-bit)
family
yi
modality
—
root model
01-ai/Yi-34B
provider
TheBloke
license
other
language
—
context
2023
library
—
vRAM (GB)
—
size on disk
—
downloads
392
likes
77
created
—
last modified
2023-11-07T09:47:44+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/Yi-34B-GGUF
tags
transformersggufyibase_model:01-ai/Yi-34Bbase_model:quantized:01-ai/Yi-34Blicense:otherregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge62.6low| LLaMA2-34B | 62.6 | - | - | - | 44.1 | 69.9 | 68.0 | 26.0 |
C-Evalknowledge58.1low| Baichuan2-13B | 59.2 | 62.0 | 58.1 | 54.3 | 48.8 | 64.3 | 62.4 | 23.0 |
CMMLUknowledge53.3low| LLaMA2-70B | 68.9 | 53.3 | - | 49.8 | 51.2 | 71.9 | 69.4 | 36.8 |
GAOKAOknowledge49.8low| LLaMA2-70B | 68.9 | 53.3 | - | 49.8 | 51.2 | 71.9 | 69.4 | 36.8 |
BBHreasoning44.1low| LLaMA2-34B | 62.6 | - | - | - | 44.1 | 69.9 | 68.0 | 26.0 |
MATHmath26.0low| LLaMA2-34B | 62.6 | - | - | - | 44.1 | 69.9 | 68.0 | 26.0 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.