family qwen · 12 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Qwen2.5-0.5B-Instruct-GGUF | gguf | gguf | 170,936 | Qwen | 2024 | ||
| Qwen2.5-0.5B-Instruct-GGUF | gguf | gguf | 2.0 | 39,692 | bartowski | 2024 | |
| Qwen2.5-0.5B-Instruct-unsloth-bnb-4bit | bnb-4bit | 4bit | 37,643 | unsloth | 2025 | ||
| Qwen2.5-0.5B-Instruct-AWQ | awq | awq | 25,145 | Qwen | 2024 | ||
| Qwen2.5-0.5B-Instruct | original | bf16 | 16.0 | 21,260 | unsloth | 2025 | |
| Qwen2.5-0.5B-Instruct-bnb-4bit | bnb-4bit | 4bit | 16,075 | unsloth | 2025 | ||
| Qwen2.5-0.5B-Instruct-GGUF | gguf | gguf | 3.0 | 7,851 | lmstudio-community | 2024 | |
| Qwen2.5-0.5B-Instruct-MLX-4bit | mlx | mlx | 7,438 | lmstudio-community | 2024 | ||
| Qwen2.5-0.5B-Instruct-GPTQ-Int4 | gptq | gptq | 1,514 | Qwen | 2024 | ||
| Qwen2.5-0.5B-Instruct-MLX-8bit | mlx | mlx | 618 | lmstudio-community | 2024 | ||
| Qwen2.5-0.5B-Instruct-GPTQ-Int8 | gptq | gptq | 522 | Qwen | 2024 | ||
| limbic-tool-use-0.5B-32K-GGUF | gguf | gguf | 16.0 | 40 | Mungert | 2025 |