HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-3_1-Nemotron-Ultra-253B-CPT-v1

nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1

kind
original
quant
bf16 (16-bit)
family
llama
modality
text-generation
root model
nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1
provider
nvidia
license
other
language
en
context
128K
library
transformers
vRAM (GB)
—
size on disk
—
downloads
83
likes
6
created
—
last modified
2025-07-06T15:51:59+00:00 (2025)
huggingface
https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1
tags
transformerssafetensorsnemotron-nastext-generationnvidiallama-3pytorchconversationalcustom_codeenarxiv:2503.18908arxiv:2411.19146license:otherregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
HumanEvalcoding88.41HumanEvalmedium| HumanEval | pass@1 | 88.41 |
MMLUknowledge88.09MMLUmedium| MMLU | macro | 88.09 |
RULERlong-context83.21RULERmedium| RULER | 128K | 83.21 |
MATH-500math80.4MATH500medium| MATH500 | micro | 80.4 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.