Home/Models/hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Meta-Llama-3.1-70B-Instruct-AWQ-INT4
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
- kind
- awq
- quant
- awq
- family
- llama
- modality
- text-generation
- root model
- meta-llama/Meta-Llama-3.1-70B
- provider
- hugging-quants
- license
- llama3.1
- language
- en, de, fr, it, pt, hi, es, th
- context
- —
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 258,512
- likes
- 110
- created
- —
- last modified
- 2024-08-07T07:16:54+00:00 (2024)
- huggingface
- https://huggingface.co/hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
- tags
- transformerssafetensorsllamatext-generationllama-3.1metaautoawqconversationalendefritpthiesthlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitawqdeploy:azureregion:us
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.