Qwen2-VL-7B-Instruct-GPTQ-Int4

Home/Models/Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

kind: gptq
quant: gptq
family: qwen
modality: image-text-to-text
root model: Qwen/Qwen2-VL-7B-Instruct
provider: Qwen
license: apache-2.0
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 2,195
likes: 37
created: —
last modified: 2024-09-21T08:41:40+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4
tags: transformerssafetensorsqwen2_vlimage-text-to-textmultimodalconversationalenarxiv:2409.12191arxiv:2308.12966base_model:Qwen/Qwen2-VL-7B-Instructbase_model:quantized:Qwen/Qwen2-VL-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitgptqregion:us

benchmark	category	score	conf	evidence
DocVQA	multimodal	93.89	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MMBench	multimodal	81.78	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MathVista	multimodal	58.2	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MMMU	multimodal	53.77	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`

none scraped.