Qwen2.5-VL-7B-Instruct-AWQ

Home/Models/Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

kind: awq
quant: awq
family: qwen
modality: image-text-to-text
root model: Qwen/Qwen2.5-VL-7B-Instruct
provider: Qwen
license: apache-2.0
language: en
context: 32,768
library: transformers
vRAM (GB): 2.5
size on disk: —
downloads: 2,748,113
likes: 105
created: —
last modified: 2025-04-06T16:25:10+00:00 (2025)
huggingface: https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct-AWQ
tags: transformerssafetensorsqwen2_5_vlimage-text-to-textmultimodalconversationalenarxiv:2309.00071arxiv:2409.12191arxiv:2308.12966base_model:Qwen/Qwen2.5-VL-7B-Instructbase_model:quantized:Qwen/Qwen2.5-VL-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitawqregion:us

benchmark	category	score	conf	evidence
DocVQA	multimodal	96.0	high	`\| \| AWQ<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct-AWQ)[🤖](https://modelscope.cn/models/qwen/Qwen2.5-VL-72B-Instruct-AWQ)) \| 69.1 \| 96.0 \| 87.9 \| 73.8 \|`
MMBench	multimodal	87.9	high	`\| \| AWQ<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct-AWQ)[🤖](https://modelscope.cn/models/qwen/Qwen2.5-VL-72B-Instruct-AWQ)) \| 69.1 \| 96.0 \| 87.9 \| 73.8 \|`
MathVista	multimodal	73.8	high	`\| \| AWQ<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct-AWQ)[🤖](https://modelscope.cn/models/qwen/Qwen2.5-VL-72B-Instruct-AWQ)) \| 69.1 \| 96.0 \| 87.9 \| 73.8 \|`

title	author	status	type
fix spelling error in read me	Flack1	open	disc
vllm implementation	TahirC	open	disc
AWQ quantization script to Qwen-VL-2.5 7B model	Berkesule	open	disc
Necessary transformers version	chefexperte	open	disc
lm head in the trained model is not in AWQ format	pooya-mohammadi	open	disc
111	132434eee	draft	disc
Is AWQ quantization applied only to the anguage model of this model?	sinchir0	open	disc
License clarification	ValerianGuillot	open	disc
Empty output when using Qwen2.5-VL-7B-Instruct-AWQ example code from README	WpythonW	open	disc
Add link to paper and code	nielsr	open	disc