family qwen · 12 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Qwen2.5-Coder-0.5B-Instruct-GGUF | gguf | gguf | 14,767 | Qwen | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct-bnb-4bit | bnb-4bit | 4bit | 6,799 | unsloth | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct | original | bf16 | 16.0 | 5,607 | unsloth | 2024 | |
| Qwen2.5-Coder-0.5B-Instruct-GGUF | gguf | gguf | 3.0 | 2,025 | lmstudio-community | 2024 | |
| Qwen2.5-Coder-0.5B-Instruct-GGUF | gguf | gguf | 3.0 | 1,836 | bartowski | 2024 | |
| Qwen2.5-Coder-0.5B-Instruct-MLX-4bit | mlx | mlx | 1,481 | lmstudio-community | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct-GGUF | gguf | gguf | 16.0 | 1,361 | unsloth | 2024 | |
| Qwen2.5-Coder-0.5B-Instruct-128K-GGUF | gguf | gguf | 16.0 | 1,133 | unsloth | 2024 | |
| Qwen2.5-Coder-0.5B-Instruct-MLX-8bit | mlx | mlx | 889 | lmstudio-community | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct-AWQ | awq | awq | 418 | Qwen | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct-GPTQ-Int4 | gptq | gptq | 359 | Qwen | 2024 | ||
| Qwen2.5-Coder-0.5B-Instruct-GPTQ-Int8 | gptq | gptq | 68 | Qwen | 2024 |