HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

AceMath-72B-RM

nvidia/AceMath-72B-RM

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
nvidia/AceMath-72B-RM
provider
nvidia
license
cc-by-nc-4.0
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
119
likes
10
created
—
last modified
2025-01-17T07:31:09+00:00 (2025)
huggingface
https://huggingface.co/nvidia/AceMath-72B-RM
tags
safetensorsnvidiaAceMathmathpytorchtext-generationenarxiv:2412.15084license:cc-by-nc-4.0region:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
MATHmath96.61Qwen2.5-Math-RM-72Bmedium| Qwen2.5-Math-RM-72B | 96.61 | 86.63 | 43.60 | 73.62 | 47.21 | 47.29 | 84.24 | 68.46 |
GSM8Kmath96.22low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |
MATH-500math83.11low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |
MMLUknowledge78.21low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |
GAOKAOknowledge68.21low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |
Math Olympiadmath42.69low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |
MATHmath41.2low| majority@8 | 96.22 | 83.11 | 41.20 | 68.21 | 42.69 | 45.01 | 78.21 | 64.95 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.