HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Nemotron-H-8B-Base-8K

nvidia/Nemotron-H-8B-Base-8K

kind
original
quant
bf16 (16-bit)
family
nemotron
modality
text-generation
root model
nvidia/Nemotron-H-8B-Base-8K
provider
nvidia
license
other
language
en, de, es, fr, it, ko, pt, ru, jp, zh
context
8K
library
transformers
vRAM (GB)
—
size on disk
—
downloads
86,116
likes
59
created
—
last modified
2025-08-21T15:45:04+00:00 (2025)
huggingface
https://huggingface.co/nvidia/Nemotron-H-8B-Base-8K
tags
transformerssafetensorsnvidiapytorchnemotron-htext-generationconversationalendeesfritkoptrujpzharxiv:2504.03624license:otherendpoints_compatibleregion:us

Benchmark scores (11)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath87.11GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 87.11 | 46.52 | 22.93 | 44.43 |
WinoGrandeknowledge80.51low| 88.74 | 83.23 | 80.51 | 78.71 |
CommonsenseQAknowledge78.71low| 88.74 | 83.23 | 80.51 | 78.71 |
MMLUknowledge72.77MMLU-Pro 5-shot CoTlow| 44.01 | 72.77 |
MBPPcoding65.37low| 65.37 | 59.52 | 58.54 | 55.49 |
HumanEvalcoding58.54low| 65.37 | 59.52 | 58.54 | 55.49 |
MATHmath46.52GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 87.11 | 46.52 | 22.93 | 44.43 |
MATH-500math44.43GSM8K 8-shot CoT | MATH 4-shot CoT | MATH-Lvl 5 4-shot CoT | MATH-500 4-shot CoTlow| 87.11 | 46.52 | 22.93 | 44.43 |
MMLU-Proknowledge44.01MMLU-Pro 5-shot CoTlow| 44.01 | 72.77 |
ARC-Challengeknowledge25.0mediumARC Challenge 25
HellaSwagknowledge10.0mediumHellaswag 10

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.