Qwen2-7B-Instruct-GPTQ-Int4
Qwen/Qwen2-7B-Instruct-GPTQ-Int4
- kind
- gptq
- quant
- gptq
- family
- qwen
- modality
- text-generation
- root model
- Qwen/Qwen2-7B-Instruct
- provider
- Qwen
- license
- apache-2.0
- language
- en
- context
- 32768,
- library
- —
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 522
- likes
- 28
- created
- —
- last modified
- 2024-08-21T10:34:22+00:00 (2024)
- huggingface
- https://huggingface.co/Qwen/Qwen2-7B-Instruct-GPTQ-Int4
- tags
- transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071base_model:Qwen/Qwen2-7B-Instructbase_model:quantized:Qwen/Qwen2-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitgptqregion:usdeploy:azure
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.