Home/Models/bartowski/Sparse-Llama-3.1-8B-2of4-GGUF
Sparse-Llama-3.1-8B-2of4-GGUF
bartowski/Sparse-Llama-3.1-8B-2of4-GGUF
- kind
- gguf
- quant
- gguf (2-bit)
- family
- llama
- modality
- text-generation
- root model
- neuralmagic/Sparse-Llama-3.1-8B-2of4
- provider
- bartowski
- license
- llama3.1
- language
- —
- context
- —
- library
- —
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 416
- likes
- 3
- created
- —
- last modified
- 2024-11-26T19:55:13+00:00 (2024)
- huggingface
- https://huggingface.co/bartowski/Sparse-Llama-3.1-8B-2of4-GGUF
- tags
- ggufvllmsparsitytext-generationbase_model:RedHatAI/Sparse-Llama-3.1-8B-2of4base_model:quantized:RedHatAI/Sparse-Llama-3.1-8B-2of4license:llama3.1endpoints_compatibleregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.