HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16

kind
original
quant
bf16 (16-bit)
family
nemotron
modality
text-generation
root model
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16
provider
nvidia
license
other
language
en, es, fr, de, ja, it, zh, ar, he, hi, ko, cs
context
1M
library
transformers
vRAM (GB)
—
size on disk
—
downloads
5,939
likes
32
created
—
last modified
2026-03-14T14:29:35+00:00 (2026)
huggingface
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16
tags
transformerssafetensorsnemotron_htext-generationnvidiapytorchnemotron-3latent-moemtpcustom_codeenesfrdejaitzharhehikocsdanl

Benchmark scores (23)

benchmarkcategoryscorecontextconfevidence
ARC-Challengeknowledge96.08ARC-Challengemedium| ARC-Challenge | 25-shot, acc_norm | **96.08** | 94.80 | 93.90 |
RULERlong-context93.17RULER 64Kmedium| RULER 64K | 0-shot | **93.17** | — | 81.58 |
GSM8Kmath90.67GSM8Kmedium| GSM8K | 8-shot, EM | 90.67 | **90.75** | 82.60 |
RULERlong-context89.0RULER 128Kmedium| RULER 128K | 0-shot | **89.00** | 57.56 | 63.62 |
HellaSwagknowledge88.97HellaSwagmedium| HellaSwag | 10-shot, acc_norm | **88.97** | 84.69 | 87.70 |
MGSMmath87.47MGSMmedium| MGSM | 8-shot, avg | **87.47** | 82.73 | 80.33 |
RULERlong-context86.18RULER 256Kmedium| RULER 256K | 0-shot | **86.18** | — | — |
MMLUknowledge86.01MMLUmedium| MMLU | 5-shot, acc | **86.01** | 81.00 | 81.00 |
MMLUknowledge85.72MMLU Global Litemedium| MMLU Global Lite | 5-shot, avg | **85.72** | 74.94 | 79.25 |
PIQAknowledge85.47PIQAmedium| PIQA | 0-shot, acc_norm | **85.47** | 84.00 | 84.22 |
MATHmath84.84MATHmedium| MATH | 4-shot, EM | **84.84** | 63.80 | 50.36 |
RULERlong-context82.16RULER 512Kmedium| RULER 512K | 0-shot | **82.16** | — | — |
HumanEvalcoding79.4HumanEvalmedium| HumanEval | 0-shot, pass@1 n=32 | **79.40** | 70.10 | 76.30 |
WinoGrandeknowledge78.93WinoGrandemedium| WinoGrande | 5-shot, acc | 78.93 | 78.37 | **83.82** |
MBPPcoding78.38MBPP-Sanitizedmedium| MBPP-Sanitized | 3-shot, pass@1 n=32 | **78.38** | 77.30 | 77.50 |
AGIEvalreasoning77.92AGIEval-Enmedium| AGIEval-En | 3/5-shot, CoT EM | **77.92** | 61.70 | 62.40 |
MMLU-Proknowledge75.65MMLU-Promedium| MMLU-Pro | 5-shot, CoT EM | **75.65** | 62.10 | 58.20 |
RULERlong-context74.39RULER 1Mmedium| RULER 1M | 0-shot | **74.39** | — | — |
MATHmath70.0MATH Level 5medium| MATH Level 5 | 4-shot, EM | **70.00** | 39.80 | 26.30 |
RULERlong-context64.0mediumRULER 64
GPQA Diamondreasoning60.0GPQA-Diamondmedium| GPQA-Diamond | 5-shot, CoT EM | **60.00** | 36.00 | 23.20 |
AIME 2024math53.33AIME 2024medium| AIME 2024 | pass@32 | **53.33** | 30.00 | 20.00 |
OpenBookQAknowledge50.2OpenBookQAmedium| OpenBookQA | 0-shot, acc_norm | **50.20** | 47.00 | 48.60 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.