nvidia/Llama-3_1-Nemotron-Ultra-253B-CPT-v1
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| HumanEval | coding | 88.41 | HumanEval | medium | | HumanEval | pass@1 | 88.41 | |
| MMLU | knowledge | 88.09 | MMLU | medium | | MMLU | macro | 88.09 | |
| RULER | long-context | 83.21 | RULER | medium | | RULER | 128K | 83.21 | |
| MATH-500 | math | 80.4 | MATH500 | medium | | MATH500 | micro | 80.4 | |
none scraped.