Qwen2.5-7B-Instruct-GPTQ-Int4
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
- kind
- gptq
- quant
- gptq
- family
- qwen
- modality
- text-generation
- root model
- Qwen/Qwen2.5-7B-Instruct
- provider
- Qwen
- license
- apache-2.0
- language
- en
- context
- 131,072
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 331,440
- likes
- 33
- created
- —
- last modified
- 2024-10-18T02:59:11+00:00 (2024)
- huggingface
- https://huggingface.co/Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
- tags
- transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-7B-Instructbase_model:quantized:Qwen/Qwen2.5-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitgptqdeploy:azureregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.