HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen2.5-VL-32B-Instruct

Qwen/Qwen2.5-VL-32B-Instruct

kind
original
quant
bf16 (16-bit)
family
qwen
modality
image-text-to-text
root model
Qwen/Qwen2.5-VL-32B-Instruct
provider
Qwen
license
apache-2.0
language
en
context
32,768
library
transformers
vRAM (GB)
—
size on disk
—
downloads
777,903
likes
498
created
—
last modified
2025-04-14T10:55:03+00:00 (2025)
huggingface
https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct
tags
transformerssafetensorsqwen2_5_vlimage-text-to-textmultimodalconversationalenarxiv:2309.00071arxiv:2502.13923license:apache-2.0eval-resultstext-generation-inferenceendpoints_compatibledeploy:azureregion:us

Benchmark scores (11)

benchmarkcategoryscorecontextconfevidence
DocVQAmultimodal96.4DocVQAmedium| DocVQA | **96.4** | **96.5** | 94.8 |
MBPPcoding84.0high| Qwen2.5-VL-32B | 78.4 | 68.8 | 82.2 | 46.0 | 84.0 | 91.5 |
MATHmath82.2high| Qwen2.5-VL-32B | 78.4 | 68.8 | 82.2 | 46.0 | 84.0 | 91.5 |
MMLUknowledge78.4high| Qwen2.5-VL-32B | 78.4 | 68.8 | 82.2 | 46.0 | 84.0 | 91.5 |
MathVistamultimodal74.8MathVistamedium| MathVista | **74.8** | 70.5 | 74.7 |
MMMUmultimodal70.2MMMUmedium| MMMU | **70.2** | 64.5 | 70 |
MMLU-Proknowledge68.8high| Qwen2.5-VL-32B | 78.4 | 68.8 | 82.2 | 46.0 | 84.0 | 91.5 |
MMMUmultimodal51.1MMMU Promedium| MMMU Pro | **51.1** | 46.2 | 49.5 |
GPQA Diamondreasoning46.0high| Qwen2.5-VL-32B | 78.4 | 68.8 | 82.2 | 46.0 | 84.0 | 91.5 |
OSWorldagentic8.83OSWorldmedium| OSWorld | **8.83** | - | 5.92 |
MMBenchmultimodal2.02MMBench-Videomedium| MMBench-Video | **2.02** | 1.7 | 1.93 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.