Qwen2.5-7B-Instruct-AWQ

Home/Models/Qwen/Qwen2.5-7B-Instruct-AWQ

Qwen/Qwen2.5-7B-Instruct-AWQ

kind: awq
quant: awq
family: qwen
modality: text-generation
root model: Qwen/Qwen2.5-7B-Instruct
provider: Qwen
license: apache-2.0
language: en
context: 131,072
library: transformers
vRAM (GB): —
size on disk: —
downloads: 4,446,238
likes: 48
created: —
last modified: 2024-10-09T12:26:45+00:00 (2024)
huggingface: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct-AWQ
tags: transformerssafetensorsqwen2text-generationchatconversationalenarxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-7B-Instructbase_model:quantized:Qwen/Qwen2.5-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitawqregion:us

no scores extracted for this variant.

title	author	status	type
Listed on OpenModelMap	duola15	open	disc
TemporalMesh Transformer: 29.4 PPL at 48% compute — beats Mamba, new open-source architecture	vigneshwar234	open	disc
Improve language tag	lbourdois	open	disc
Inference problems in transformers==4.50.0	mirekphd	open	disc
why pad token don't specify in config file ?	linzhuo	open	disc
Update metadata with huggingface_hub	reach-vb	merged	disc