unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-FP8
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| RULER | long-context | 96.79 | RULER-500 @ 128k (500 samples per task) | medium | | RULER-500 @ 128k (500 samples per task) | 96.79 | 96.85 | 95.99 | |
| RULER | long-context | 96.6 | RULER-500 @ 256k (500 samples per task) | medium | | RULER-500 @ 256k (500 samples per task) | 96.60 | 96.33 | 96.52 | |
| RULER | long-context | 96.09 | RULER-500 @ 512k (500 samples per task) | medium | | RULER-500 @ 512k (500 samples per task) | 96.09 | 95.66 | 96.23 | |
| MMLU-Pro | knowledge | 83.73 | MMLU-Pro | medium | | MMLU-Pro | 83.73 | 83.63 | 83.33 | |
| LiveCodeBench | coding | 81.19 | LiveCodeBench (v5 2024-07↔2024-12) | medium | | LiveCodeBench (v5 2024-07↔2024-12) | 81.19 | 80.99 | 80.56 | |
| MMLU-Pro | knowledge | 79.35 | MMLU-ProX (avg over languages) | medium | | MMLU-ProX (avg over languages) | 79.35 | 79.21 | 79.37 | |
| GPQA | reasoning | 79.23 | GPQA (no tools) | medium | | GPQA (no tools) | 79.23 | 79.36 | 79.42 | |
| LiveCodeBench | coding | 78.69 | LiveCodeBench (v6 2024-08↔2025-05) | medium | | LiveCodeBench (v6 2024-08↔2025-05) | 78.69 | 78.44 | 78.44 | |
| Chatbot Arena | chat | 73.88 | Arena-Hard-V2 (Hard Prompt) | medium | | Arena-Hard-V2 (Hard Prompt) | 73.88 | 76.06 | 76.00 | |
| IFBench | instruction-following | 72.58 | IFBench (prompt) | medium | | IFBench (prompt) | 72.58 | 72.32 | 73.30 | |
| SciCode | coding | 42.05 | SciCode (subtask) | medium | | SciCode (subtask) | 42.05 | 41.38 | 40.83 | |
| Terminal-Bench | agentic-coding | 25.78 | Terminal Bench (hard subset) | medium | | Terminal Bench (hard subset) | 25.78 | 26.04 | 24.48 | |
| Humanity's Last Exam | knowledge | 18.26 | HLE (no tools) | medium | | HLE (no tools) | 18.26 | 17.42 | 17.42 | |
none scraped.