HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

DeepSeek-V4-Pro

unsloth/DeepSeek-V4-Pro

kind
fp8
quant
fp8 (8-bit)
family
deepseek
modality
text-generation
root model
deepseek-ai/DeepSeek-V4-Pro
provider
unsloth
license
mit
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
172
likes
62
created
—
last modified
2026-04-24T15:54:36+00:00 (2026)
huggingface
https://huggingface.co/unsloth/DeepSeek-V4-Pro
tags
transformerssafetensorsdeepseek_v4text-generationbase_model:deepseek-ai/DeepSeek-V4-Probase_model:quantized:deepseek-ai/DeepSeek-V4-Prolicense:mitendpoints_compatible8-bitfp8region:us

Benchmark scores (27)

benchmarkcategoryscorecontextconfevidence
GPQA Diamondreasoning91.3GPQA Diamond (Pass@1)medium| GPQA Diamond (Pass@1) | 91.3 | 93.0 | **94.3** | 90.5 | 86.2 | 90.1 |
GSM8Kmath91.1GSM8K (EM)medium| GSM8K (EM) | 8-shot | 91.1 | 90.8 | **92.6** |
C-Evalknowledge90.4C-Eval (EM)medium| C-Eval (EM) | 5-shot | 90.4 | 92.1 | **93.1** |
CMMLUknowledge88.9CMMLU (EM)medium| CMMLU (EM) | 5-shot | 88.9 | 90.4 | **90.8** |
LiveCodeBenchcoding88.8LiveCodeBench (Pass@1)medium| LiveCodeBench (Pass@1) | 88.8 | - | 91.7 | 89.6 | - | **93.5** |
DROPreasoning88.2DROP (F1)medium| DROP (F1) | 1-shot | 88.2 | 88.6 | **88.7** |
MMLUknowledge87.8MMLU (EM)medium| MMLU (EM) | 5-shot | 87.8 | 88.7 | **90.1** |
BBHreasoning87.6BBH (EM)medium| BBH (EM) | 3-shot | **87.6** | 86.9 | 87.5 |
MMLUknowledge87.5MMLU-Redux (EM)medium| MMLU-Redux (EM) | 5-shot | 87.5 | 89.4 | **90.8** |
HellaSwagknowledge86.4HellaSwag (EM)medium| HellaSwag (EM) | 0-shot | 86.4 | 85.7 | **88.0** |
BrowseCompagentic83.7BrowseComp (Pass@1)medium| BrowseComp (Pass@1) | 83.7 | 82.7 | **85.9** | 83.2 | 79.3 | 83.4 |
TriviaQAknowledge83.3TriviaQA (EM)medium| TriviaQA (EM) | 5-shot | 83.3 | 82.8 | **85.6** |
MGSMmath81.3MGSM (EM)medium| MGSM (EM) | 8-shot | 81.3 | **85.7** | 84.4 |
AGIEvalreasoning80.1AGIEval (EM)medium| AGIEval (EM) | 0-shot | 80.1 | 82.6 | **83.1** |
WinoGrandeknowledge78.9WinoGrande (EM)medium| WinoGrande (EM) | 0-shot | 78.9 | 79.5 | **81.5** |
SimpleQAknowledge76.4Chinese-SimpleQA (Pass@1)medium| Chinese-SimpleQA (Pass@1) | 76.4 | 76.8 | **85.9** | 75.9 | 75.0 | 84.4 |
MMLU-Proknowledge65.5MMLU-Pro (EM)medium| MMLU-Pro (EM) | 5-shot | 65.5 | 68.3 | **73.5** |
Terminal-Bench 2.0agentic-coding65.4Terminal Bench 2.0 (Acc)medium| Terminal Bench 2.0 (Acc) | 65.4 | **75.1** | 68.5 | 66.7 | 63.5 | 67.9 |
BigCodeBenchcoding63.9BigCodeBench (Pass@1)medium| BigCodeBench (Pass@1) | 3-shot | **63.9** | 56.8 | 59.2 |
HumanEvalcoding62.8HumanEval (Pass@1)medium| HumanEval (Pass@1) | 0-shot | 62.8 | 69.5 | **76.8** |
MATHmath60.5MATH (EM)medium| MATH (EM) | 4-shot | 60.5 | 57.4 | **64.5** |
Humanity's Last Examknowledge53.1HLE w/ tools (Pass@1)medium| HLE w/ tools (Pass@1) | 53.1 | 52.0 | 51.6 | **54.0** | 50.4 | 48.2 |
SimpleQAknowledge46.2SimpleQA-Verified (Pass@1)medium| SimpleQA-Verified (Pass@1) | 46.2 | 45.3 | **75.6** | 36.9 | 38.1 | 57.9 |
LongBenchlong-context40.2LongBench-V2 (EM)medium| LongBench-V2 (EM) | 1-shot | 40.2 | 44.7 | **51.5** |
Humanity's Last Examknowledge40.0HLE (Pass@1)medium| HLE (Pass@1) | 40.0 | 39.8 | **44.4** | 36.4 | 34.7 | 37.7 |
SimpleQAknowledge28.3Simple-QA verified (EM)medium| Simple-QA verified (EM) | 25-shot | 28.3 | 30.1 | **55.2** |
Terminal-Benchagentic-coding2.0mediumTerminal Bench 2.0

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.