nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| RULER | long-context | 95.1 | RULER @ 256k | medium | | RULER @ 256k | 95.1 | 95.3 | 95.3 | |
| RULER | long-context | 94.2 | RULER @ 512k | medium | | RULER @ 512k | 94.2 | 94.5 | 94.8 | |
| RULER | long-context | 92.2 | RULER @ 1M | medium | | RULER @ 1M | 92.2 | 92.4 | 93.2 | |
| AIME 2025 | math | 89.7 | AIME25 (no tools) | medium | | AIME25 (no tools) | 89.7 | 89.4 | 89.9 | |
| MMLU-Pro | knowledge | 82.4 | MMLU-Pro | medium | | MMLU-Pro | 82.4 | 82.0 | 82.2 | |
| LiveCodeBench | coding | 81.1 | LiveCodeBench (v5 2024-07↔2024-12) | medium | | LiveCodeBench (v5 2024-07↔2024-12) | 81.1 | 80.5 | 79.9 | |
| GPQA | reasoning | 79.5 | GPQA (with tools) | medium | | GPQA (with tools) | 79.5 | 80.6 | 78.2 | |
| GPQA | reasoning | 78.6 | GPQA (no tools) | medium | | GPQA (no tools) | 78.6 | 77.8 | 78.0 | |
| MMLU-Pro | knowledge | 77.5 | MMLU-ProX (avg over langs) | medium | | MMLU-ProX (avg over langs) | 77.5 | 77.1 | 76.5 | |
| IFBench | instruction-following | 71.9 | IFBench (prompt) | medium | | IFBench (prompt) | 71.9 | 71.9 | 71.3 | |
| Chatbot Arena | chat | 68.6 | Arena-Hard-V2 | medium | | Arena-Hard-V2 | 68.6 | 69.8 | 69.0 | |
| SciCode | coding | 40.6 | SciCode (subtask) | medium | | SciCode (subtask) | 40.6 | 39.6 | 40.3 | |
| Terminal-Bench | agentic-coding | 24.0 | Terminal Bench (hard subset) | medium | | Terminal Bench (hard subset) | 24.0 | 22.9 | 23.4 | |
| Humanity's Last Exam | knowledge | 16.5 | HLE (no tools) | medium | | HLE (no tools) | 16.5 | 16.0 | 15.7 | |
none scraped.