Qwen2-72B-Instruct-GPTQ-Int4
Qwen/Qwen2-72B-Instruct-GPTQ-Int4
- kind
- gptq
- quant
- gptq
- family
- qwen
- modality
- text-generation
- root model
- Qwen/Qwen2-72B-Instruct
- provider
- Qwen
- license
- other
- language
- en
- context
- 32768,
- library
- —
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 83
- likes
- 33
- created
- —
- last modified
- 2024-08-21T10:27:09+00:00 (2024)
- huggingface
- https://huggingface.co/Qwen/Qwen2-72B-Instruct-GPTQ-Int4
- tags
- transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071base_model:Qwen/Qwen2-72B-Instructbase_model:quantized:Qwen/Qwen2-72B-Instructlicense:othertext-generation-inferenceendpoints_compatible4-bitgptqregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.