Home/Models/hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Meta-Llama-3.1-405B-Instruct-AWQ-INT4
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
- kind
- awq
- quant
- awq
- family
- llama
- modality
- text-generation
- root model
- meta-llama/Meta-Llama-3.1-405B
- provider
- hugging-quants
- license
- llama3.1
- language
- en, de, fr, it, pt, hi, es, th
- context
- —
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 1,216
- likes
- 36
- created
- —
- last modified
- 2024-09-13T06:37:37+00:00 (2024)
- huggingface
- https://huggingface.co/hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
- tags
- transformerssafetensorsllamatext-generationllama-3.1metaautoawqconversationalendefritpthiesthlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitawqdeploy:azureregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.