HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

DeepSeek-R1

deepseek-ai/DeepSeek-R1

kind
fp8
quant
fp8 (8-bit)
family
deepseek
modality
text-generation
root model
deepseek-ai/DeepSeek-R1
provider
deepseek-ai
license
mit
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
8,860,456
likes
13,511
created
—
last modified
2025-03-27T04:01:59+00:00 (2025)
huggingface
https://huggingface.co/deepseek-ai/DeepSeek-R1
tags
transformerssafetensorsdeepseek_v3text-generationconversationalcustom_codearxiv:2501.12948license:miteval-resultstext-generation-inferenceendpoints_compatiblefp8deploy:sagemakerregion:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
MATH-500math74.6low| GPT-4o-0513 | 9.3 | 13.4 | 74.6 | 49.9 | 32.9 | 759 |
GPQA Diamondreasoning49.9low| GPT-4o-0513 | 9.3 | 13.4 | 74.6 | 49.9 | 32.9 | 759 |
LiveCodeBenchcoding32.9low| GPT-4o-0513 | 9.3 | 13.4 | 74.6 | 49.9 | 32.9 | 759 |
MATHmath16.0Mathmedium| Math | AIME 2024 (Pass@1) | 16.0 | 9.3 | 39.2 | 63.6 | 79.2 | **79.8** |
AIME 2024math9.3low| GPT-4o-0513 | 9.3 | 13.4 | 74.6 | 49.9 | 32.9 | 759 |

Discussions (242)

titleauthorstatuscommentstype
Update README.mdshyamwertyajmopen0disc
Listed on OpenModelMapduola15open0disc
R1 on mobile — we tested the limits3morixdopen0disc
New architecture: TemporalMesh Transformer — dynamic kNN graph attention + per-token exit routing, 29.4 PPL at 48% computevigneshwar234open0disc
testLuzika01883draft0disc
Add EvalEval community eval resultsEvalEvalBotclosed0disc
Add LEXam evaluation resultsjoelniklausopen0disc
Fix `chat_template` crash when assistant message omits the `content` keyqgallouedecopen0disc
[Feature request] Eliminate pre-attention RMSNorm in MLA-models via scale invariance + weight foldinggraeficsopen0disc
DeepSeek-R1-1usmanashe26draft0disc
Using DeepSeek R1 via API Gatewayxujfcnopen0disc
Deepseek R1 Requestbach619draft0disc
Add MMLU-Pro evaluation result (84.0)burtenshawopen0disc
Add GPQA evaluation resultburtenshawopen0disc
Add GPQA evaluation resultsnielsropen0disc
Upload internal.pyAnanthusajeev190open0disc
Create .eval_results/mmlu_pro.yamlnielsrclosed0disc
[Alignment Analysis] R1 hallucinates medical false equivalencies unless strictly constrained (Diabetes vs Psychiatry)felps333open0disc
[Hallucination Report] Model hallucinates biological validity in psychiatric analogiesfelps333open0disc
Set Max Model Length to correct valuechandra-reddydraft0disc
Update README.mdvivienfanghuaopen0disc
Update README.mdBrokersponsoropen0disc
Model's Resource Utilizationkalashshah19open0disc
Update README.mdahmedgg12open0disc
Update README.mdKiokanaclosed0disc
Tokenizer difference between deepseek and qwen3yangsketchopen0disc
updated version?CHNtentesopen0disc
日期出现乱码CloudChinaopen0disc
testBellandryclosed0disc
Update README.mdXternnopen0disc
dsasdAxdardraft0disc
DeepSeek R1 model Bad Cases Genuine User Reviews and Comments CollectionDeepNLPopen0disc
Update README.mdRudra160113open0disc
Update README.mdpezhmansamaniiiopen0disc
Update README.mdpezhmansamaniiiopen0disc
🚩 Report: Copyright infringementking455open0disc
Remove "NOTE: Hugging Face's Transformers has not been directly supported yet." in READMEandrewrreedopen0disc
Update README.mdrshaikh22open0disc
World's Largest Datasetdeletedopen0disc
Request: DOIyahyaali77824open0disc
Knowledge / Training Cutoff of DeepSeek R1MengboZhouopen0disc
Update README.mdRainbowbeastopen0disc
Make config params float to avoid warning in TransformersRocketknight1open0disc
Update README.mdBrokersponsoropen0disc
Upload 1743103973740.jpgDiamond01closed0disc
Update README.mdmehdi131open0disc
Update README.mdYUIHGopen0disc
DeepSeek中o1-1217的数据是哪里来的。我好像没在OpenAI的官方途径找到,谢谢🙏747860199qqopen0disc
Any R1 reasoning researchers looking for samples?natcolleyopen0disc
Update README.mdumar759open0disc
Request: DOIYenugu12open0disc
Create 9889555keyi8open0disc
Upload 657f0f06e7ea1b09462a7a16_Feedback and evaluation-p-500.pnglikhonsheikhopen0disc
lucasPRlucas2016closed0disc
Best practice for R1 models evaluation: Reasoning efficiency and Performance by MATH-Levelwangxingjun778open0disc
Производство изобутиленаMarumarymariclosed0disc
DeepSeek R1 full-power version occasionally ends without returning </think>.yizhieziopen0disc
deepseek满血版偶现结束没有返回 </think>yizhieziopen0disc
Standing at a flag in NetherlandsSweetstacgopen0disc
Delete Config.jsonjana0010open0disc
Update README.mdcaraanchoaopen0disc
为助手回答添加 <think>\n> 标签,确保一致性REN0430open0disc
为首token加上<think>REN0430closed0disc
fix for transformers 4.49 compatibilitykatuni4kaopen0disc
MLLM交流群YLHXopen0disc
nothingwhxinclosed0disc
Question about experts selectBXsetopen0disc
Hardware Requirements to run the original model - 671B paramsEdilCamilopen0disc
Holding paper in handLoveylopen0disc
Standing on the beachLoveylclosed0disc
Update config.jsonEmpolean2640open0disc
Regression in Reasoning Tag Output - Missing <think> in Model Responsesdivinerapieropen0disc
Delete model.safetensors.index.jsonHuggingfaceliajopen0disc
Unknown quantization type, got fp8DenisFavaCerchiaroopen0disc
如何取消/省略<think></think>过程。yech520open0disc
Request: DOITamwynopen0disc
Request: DOIsaathwikopen0disc
Request: DOIPaulabadopen0disc
Draft model as accelerator for DeepSeek-R1?inputoutopen0disc
Choosing the Appropriate add_noise() Method in diffusers.schedulers and Compatibility with Different Schedulers for Data Generationllmyclosed0disc
Does R1 support long context (> 4K)?ghostplantclosed0disc
Deploying production ready service with Unsloth GGUF quants on your AWS account. (4 x L40S)samagra-tensorfuseopen0disc
是否可以关注Perplexity推出的“r1-1776”模型?yanyihanopen0disc
Just crossed 10,000 likes!clemopen0disc
mac上面无法下载flash_attnearlyIsLateopen0disc
Can this model be used for commercial use?henrycwfopen0disc
90+ tokens per second for MI300x8 using batch_size = 1ghostplantopen0disc
RytryR1Rocka01open0disc
"aha moment" comment deleted by Perplexity (recovered)FalconNetopen0disc
输出乱码cell22open0disc
'num_hidden_​​layers': 61, but layer 62 has weights.xinheopen0disc
Upload GTG Breaking every LimitGTGenesisopen0disc
Update config.jsonjana0010closed0disc
Upload 1.txtDuHtclosed0disc
support prefix completeHuggineAllenopen0disc
Create app.pySpaceAgeRoboticsopen0disc
Create 1madeviiopen0disc
BrokersponsorBrokersponsoropen0disc
Update README.mdegegvneropen0disc
deepzglguilinclosed0disc
Upload IMG_4530.pngNoemie202586open0disc
Upload IMG_1745.JPGLadibopen0disc
Create ClaraClblinksopen0disc
If I understand correctly, evaluating MATH-500 requires 64*500 model calls?Rorschaaaachopen0disc
Request: DOITarush-Appreciateopen0disc
Update README.mdtekno-poweropen0disc
Update README.mdEkimnedops6969open0disc
Update README.mdEkimnedops6969closed0disc
Adding <think>\n after chat template will cause vllm to not return reasoning_content (null) when reasoningkebeliuclosed0disc
Update README.mdMuhammadEhsanopen0disc
Request for Information on Purchasing Reasoning API Keybrahamaandaiopen0disc
ssssDZGTopen0disc
Update model_max_length in tokenizer_config.jsonkkokkie2360open0disc
Host of the modelhenrycwfopen0disc
Lite version for DeepSeek-R1?haili-tianopen0disc
[Bug] assert not self.trainingGaieopen0disc
fix: update config.json to remove quantazation configdenisselluclosed0disc
Upload IMG_0253.HEICryntyopen0disc
Upload comment-sample.xlsxfaham123open0disc
non-reasoning datamccatecopen0disc
能不能放一些 4bit的权重,现在手里面的卡都不支持FP8zhnagchenchneopen0disc
Request: DOIwxyugbjclosed0disc
For the universe! DeepPhaser.py DeepCoralX.py and DeepSynapse.pykarmikovicopen0disc
Request: Create distill of Mistral Small 24BKenshiro-28open0disc
which vision model is R1 using for text extraction from image or pdfs.ashutoshroy02open0disc
PRIIbajramanidraft0disc
Request: DOIYungchizzyopen0disc
Little brother(s) of big DeepSeek-R1 ?MrDevolveropen0disc
Upload gugagagaggagagagga.pdfHahahhahHopen0disc
Tool / Function Callingsmcleodclosed0disc
Change quant_method to bitsandbytes_4bitngoc24794open0disc
Unknown quantization typeReewaz321open0disc
UPdate config.jsonkeerthanaOfficial2001open0disc
所以部署一个671B的模型 显存需要多少 有什么基准的硬件配置?cena163open0disc
nodejsk1deopen0disc
Upload IMG_20240813_033412.jpgAmrit12345678closed0disc
Distill Compatibility for PC w/ Ryzen 7 Pro 8840HS w/ 780M Graphics 2x32GB RAM 1TB DDR5 SSDarzxopen0disc
Upload gitattributes.txtSafeerChalilopen0disc
Introducing Deepseek's TinyZeroDeepSeekModeratoropen0disc
Create Kuch vgamerdowntownopen0disc
Request: DOIHassanabbas2975open0disc
quantization fp8 error occuring while using pipeline approach or transformer based approachneethuvmopen0disc
Deepseek-R1KudanTaodraft0disc
deepseek-r1 源码中采用 MLA 架构的 KV Cache 压缩存储策略的实现似乎与文中说的不一致,这是为什么?代码中似乎没实现这个大优化Darkdustopen0disc
In bedroommakecashclosed0disc
Eating food in a carAyinbaby1313open0disc
Him in the hospitalMrsauceclosed0disc
Update README.mdjungvaclavopen0disc
error while downloading modelheikhama1982open0disc
Upload IMG_20250112_172711.jpgaamir1open0disc
help from italyMMPPIIAAopen0disc
R1 distill to Mistral Small?nfunctoropen0disc
Running this model on Google Colab?Zakiaopen0disc
请问下deepseek的同学,能不能train出一个 stable 的 moe model?tflchinaopen0disc
How to download DeepSeek-R1 7B parametersbarqawizopen0disc
HuggingFace version does NOT use efficient MLA cachingAvelinaopen0disc
Found a bugamalgunatilakeopen0disc
Upload IMG-20250115-WA0015.jpgNdukadabossclosed0disc
Let's Give Credit Where It’s Due: Adding Source Links to AI ResponsesMunis01open0disc
When will this be available in Transformers library?solwolopen0disc
cannot regenerate (blank respone)pluhongopen0disc
A Bug using hugging face APIKevin355open0disc
Do we need an authorization access to use this ?Natwaropen0disc
where is the source code for this Model ? - what does they prodoudly say by open-source models?tstarksysopen0disc
HjjjjImole2023closed0disc
智王发布deepseek-r1懒人包,解压即用Deepseek-r1 Lazy Package, easy to decompress and usezwpythonopen0disc
model-00078-of-000163.safetensors not marked safe?aborstopen0disc
Create DareDara996open0disc
problem with using serverless inferencemanju2345open0disc
Some weird sensorship on unsensitive topic. 对非敏感话题的奇怪审查。junnanwuopen0disc
Upload dkfoEtm3H4bMcaI0KEJbq.1023.jpegluckysalami089open0disc
Update README.mdNuoNbopen0disc
🚩 Report: Ethical issue(s)Typeofprototypeopen0disc
Deepseek-R1 falls: ZW demon redesigns' Nine Birds' Deepseek-R1沦陷:zw魔改版“九只鸟”zwpythonopen0disc
The Magic Token Framework: A Context-Aware, Metacognitive Architecture for Robust AI Decision-MakingIvan1972closed0disc
Consistency, can Deepseek pass?一致性,deepseek能及格吗?zwpythonopen0disc
Does this model support text insertion (fill in middle)?AayushShahopen0disc
Thoughts on deepseek-r1. Correct me if I'm wrongpkmsopen0disc
Remove unavailable importRocketknight1closed0disc
ImportError: cannot import name 'is_torch_greater_or_equal_than_1_13' from 'transformers.pytorch_utils'bashir-abubakaropen0disc
DeepSeek-R1 // $R1DeepSeekAlclosed0disc
e-currencyZhendaxieopen0disc
Meet PEEPSEEK, the first meme made by DeepSeek r1deepseeker3b56open0disc
鲸 Logo transparentDorianDarko2525open0disc
Meet Finley, the Whale of DeepSeek!deepseekjanusopen0disc
最近的炒作和硬币Chester1111open0disc
Office Cat Pippa :3deepseekjanusclosed0disc
Official DeepThink Crypto Currencyqwen-llmopen0disc
Congrats, this is the by far the best open source model! Just a few steps until complete domination (feedback)Dampfinchenopen0disc
deepseekdenizkaya2022draft0disc
Modify abbreviations in benchmark images into full name to avoid confusionkarminskiopen0disc
Create forkCwHedgehogclosed0disc
HizkuntzaJoxioopen0disc
Upload 250d0a04-673e-492b-b97f-a30ebf6a327c.jpegDeey22closed0disc
How to deploy DeepSeek-R1 witn LMDeploy ?vansinopen0disc
QwenMoukliopen0disc
使用不带 thinking 的数据集微调时无法正常生成HuanLinopen0disc
Use memory to store inactive expertsxm10086open0disc
qwen32B蒸馏模型,长度>8k时,预测一定比例乱码,出现<think><think><think><think><think><think>daniellibinopen0disc
Update LICENSEtown24open0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.