HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen2.5-Coder-32B-Instruct-AWQ

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

kind
awq
quant
awq
family
qwen
modality
text-generation
root model
Qwen/Qwen2.5-Coder-32B-Instruct
provider
Qwen
license
apache-2.0
language
en
context
131,072
library
transformers
vRAM (GB)
—
size on disk
—
downloads
1,871,552
likes
37
created
—
last modified
2024-11-18T12:55:21+00:00 (2024)
huggingface
https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct-AWQ
tags
transformerssafetensorsqwen2text-generationcodecodeqwenchatqwenqwen-coderconversationalenarxiv:2409.12186arxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-Coder-32B-Instructbase_model:quantized:Qwen/Qwen2.5-Coder-32B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitawqdeploy:azureregion:us

Benchmark scores (0)

no scores extracted for this variant.

Discussions (1)

titleauthorstatuscommentstype
TemporalMesh Transformer: 29.4 PPL at 48% compute — beats Mamba, new open-source architecturevigneshwar234open0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.