HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Nemotron-H-56B-Base-8K

nvidia/Nemotron-H-56B-Base-8K

kind
original
quant
bf16 (16-bit)
family
nemotron
modality
text-generation
root model
nvidia/Nemotron-H-56B-Base-8K
provider
nvidia
license
other
language
en, de, es, fr, it, ko, pt, ru, jp, zh
context
8K
library
transformers
vRAM (GB)
—
size on disk
—
downloads
16,431
likes
33
created
—
last modified
2025-08-21T15:45:48+00:00 (2025)
huggingface
https://huggingface.co/nvidia/Nemotron-H-56B-Base-8K
tags
transformerssafetensorsnvidiapytorchnemotron-htext-generationendeesfritkoptrujpzharxiv:2504.03624license:othereval-resultsendpoints_compatibleregion:us

Benchmark scores (11)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath93.71GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 93.71 | 59.42 | 35.19 | 57.37 |
CommonsenseQAknowledge86.73low| 94.97 | 89.00 | 84.45 | 86.73 |
WinoGrandeknowledge84.45low| 94.97 | 89.00 | 84.45 | 86.73 |
MMLUknowledge84.21MMLU-Pro 5-shot CoTlow| 60.51 | 84.21 |
MBPPcoding77.82low| 77.82 | 67.20 | 60.37 | 54.27 |
MMLU-Proknowledge60.51MMLU-Pro 5-shot CoTlow| 60.51 | 84.21 |
HumanEvalcoding60.37low| 77.82 | 67.20 | 60.37 | 54.27 |
MATHmath59.42GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 93.71 | 59.42 | 35.19 | 57.37 |
MATH-500math57.37GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 93.71 | 59.42 | 35.19 | 57.37 |
ARC-Challengeknowledge25.0mediumARC Challenge 25
HellaSwagknowledge10.0mediumHellaswag 10

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.