family falcon · 8 variants · unknown
no scores.
| variant | kind | quant | bits | vRAM | dl | org | year |
|---|---|---|---|---|---|---|---|
| Falcon3-7B-Instruct-1.58bit | original | bf16 | 16.0 | 1,702 | tiiuae | 2025 | |
| Falcon3-7B-Instruct-GGUF | gguf | gguf | 2.0 | 1,111 | bartowski | 2024 | |
| Falcon3-7B-Instruct-GPTQ-Int8 | gptq | gptq | 458 | tiiuae | 2025 | ||
| Falcon3-7B-Instruct-GGUF | gguf | gguf | 16.0 | 382 | tiiuae | 2025 | |
| Falcon3-7B-Instruct-1.58bit-GGUF | gguf | gguf | 179 | tiiuae | 2024 | ||
| Falcon3-7B-Instruct-AWQ | awq | awq | 125 | tiiuae | 2025 | ||
| Falcon3-7B-Instruct-GPTQ-Int4 | gptq | gptq | 113 | tiiuae | 2025 | ||
| Falcon3-7B-Instruct-GGUF | gguf | gguf | 3.0 | 51 | lmstudio-community | 2024 |