nvidia/NVLM-D-72B
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| DocVQA | multimodal | 92.6 | low | | NVLM-D 1.0 72B (Huggingface) | 58.7 / 54.9 | 65.2 | 852 | 94.2 | 86.0 | 92.6 | 82.6 | 69.5 | 85.4 | | |
| GSM8K | math | 90.8 | low | | Gemini Pro 1.5 (Aug 2024) | N/A | 85.9 | 90.8 | 67.7 | 84.1 | 82.1 | | |
| HumanEval | coding | 90.2 | low | | GPT-4.0 | N/A | 88.7 | - | 76.6 | 90.2 | - | | |
| MMLU | knowledge | 88.7 | low | | GPT-4.0 | N/A | 88.7 | - | 76.6 | 90.2 | - | | |
| ChartQA | multimodal | 86.0 | low | | NVLM-D 1.0 72B (Huggingface) | 58.7 / 54.9 | 65.2 | 852 | 94.2 | 86.0 | 92.6 | 82.6 | 69.5 | 85.4 | | |
| MATH | math | 76.6 | low | | GPT-4.0 | N/A | 88.7 | - | 76.6 | 90.2 | - | | |
| MathVista | multimodal | 65.2 | low | | NVLM-D 1.0 72B (Huggingface) | 58.7 / 54.9 | 65.2 | 852 | 94.2 | 86.0 | 92.6 | 82.6 | 69.5 | 85.4 | |
none scraped.