NeuralQuant-9B-GGUF
TheBloke/NeuralQuant-9B-GGUF
- kind
- gguf
- quant
- gguf (2-bit)
- family
- misc
- modality
- —
- root model
- mlabonne/NeuralQuant-9B
- provider
- TheBloke
- license
- apache-2.0
- language
- —
- context
- 32768,
- library
- —
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 125
- likes
- 1
- created
- —
- last modified
- 2023-12-30T07:52:17+00:00 (2023)
- huggingface
- https://huggingface.co/TheBloke/NeuralQuant-9B-GGUF
- tags
- transformersggufmistralmergebase_model:mlabonne/NeuralQuant-9Bbase_model:quantized:mlabonne/NeuralQuant-9Blicense:apache-2.0region:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.