family qwen · 14 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Qwen2.5-Coder-3B-Instruct-GGUF | gguf | gguf | 61,952 | Qwen | 2024 | ||
| Qwen2.5-Coder-3B-Instruct-bnb-4bit | bnb-4bit | 4bit | 19,745 | unsloth | 2024 | ||
| Qwen2.5-Coder-3B-Instruct-GGUF | gguf | gguf | 2.0 | 12,528 | bartowski | 2024 | |
| Qwen2.5-Coder-3B-Instruct-AWQ | awq | awq | 10,736 | Qwen | 2024 | ||
| Qwen2.5-Coder-3B-Instruct-GGUF | gguf | gguf | 3.0 | 9,065 | lmstudio-community | 2024 | |
| Qwen2.5-Coder-3B-Instruct-128K-GGUF | gguf | gguf | 16.0 | 4,788 | unsloth | 2024 | |
| Qwen2.5-Coder-3B-Instruct-MLX-4bit | mlx | mlx | 4,058 | lmstudio-community | 2024 | ||
| Qwen2.5-Coder-3B-Instruct-GGUF | gguf | gguf | 16.0 | 3,337 | unsloth | 2024 | |
| Qwen2.5-Coder-3B-Instruct | original | bf16 | 16.0 | 1,877 | unsloth | 2024 | |
| Qwen2.5-Coder-3B-Instruct-MLX-8bit | mlx | mlx | 1,492 | lmstudio-community | 2024 | ||
| Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF | gguf | gguf | 8.0 | 1,014 | ggml-org | 2025 | |
| Qwen2.5-Coder-3B-Instruct-GPTQ-Int4 | gptq | gptq | 753 | Qwen | 2024 | ||
| Arch-Agent-3B-GGUF | gguf | gguf | 16.0 | 75 | Mungert | 2025 | |
| Qwen2.5-Coder-3B-Instruct-GPTQ-Int8 | gptq | gptq | 58 | Qwen | 2024 |