Qwen2-VL-7B-Instruct-GPTQ-Int8

Home/Models/Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

kind: gptq
quant: gptq
family: qwen
modality: image-text-to-text
root model: Qwen/Qwen2-VL-7B-Instruct
provider: Qwen
license: apache-2.0
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 2,811
likes: 31
created: —
last modified: 2024-09-21T08:43:46+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8
tags: safetensorsqwen2_vlmultimodalimage-text-to-textconversationalenarxiv:2409.12191arxiv:2308.12966base_model:Qwen/Qwen2-VL-7B-Instructbase_model:quantized:Qwen/Qwen2-VL-7B-Instructlicense:apache-2.08-bitgptqregion:us

benchmark	category	score	conf	evidence
DocVQA	multimodal	93.89	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MMBench	multimodal	81.78	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MathVista	multimodal	58.2	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`
MMMU	multimodal	53.77	high	`\| Qwen2-VL-7B-Instruct \| BF16<br><sup>([🤗](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)[🤖](https://modelscope.cn/models/qwen/Qwen2-VL-7B-Instruct)) \| 53.77 \| 93.89 \| 81.78 \| 5`

none scraped.