HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/deepseek-ai/deepseek-ai/DeepSeek-V2-Lite-Chat

deepseek-ai/DeepSeek-V2-Lite-Chat

family deepseek · 1 variants · unknown

provider
deepseek-ai
released
—
huggingface
https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite-Chat
best scores
MMLU: 48.2BBH: 39.5C-Eval: 45.0CMMLU: 47.2HumanEval: 26.2MBPP: 39.0GSM8K: 17.4MATH: 3.3

Best scores per benchmark

benchmarkcategorybest score
MMLUknowledge48.2
CMMLUknowledge47.2
C-Evalknowledge45.0
BBHreasoning39.5
MBPPcoding39.0
HumanEvalcoding26.2
GSM8Kmath17.4
MATHmath3.3

Variants (1)

variantkindquantbitsvRAMdlorgyear
DeepSeek-V2-Lite-Chatoriginalbf1616.01,211,911deepseek-ai2024
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.