Qwen2.5-14B-Instruct-GPTQ-Int8
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8
- kind
- gptq
- quant
- gptq
- family
- qwen
- modality
- text-generation
- root model
- Qwen/Qwen2.5-14B-Instruct
- provider
- Qwen
- license
- apache-2.0
- language
- en
- context
- 131,072
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 1,830
- likes
- 26
- created
- —
- last modified
- 2024-10-09T12:27:32+00:00 (2024)
- huggingface
- https://huggingface.co/Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8
- tags
- transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-14B-Instructbase_model:quantized:Qwen/Qwen2.5-14B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible8-bitgptqregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.