Home/Models/meta-llama/Llama-3.1-405B-Instruct-FP8
Llama-3.1-405B-Instruct-FP8
meta-llama/Llama-3.1-405B-Instruct-FP8
- kind
- fp8
- quant
- fp8 (8-bit)
- family
- llama
- modality
- text-generation
- root model
- meta-llama/Meta-Llama-3.1-405B-Instruct
- provider
- meta-llama
- license
- llama3.1
- language
- en, de, fr, it, pt, hi, es, th
- context
- —
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 15,725
- likes
- 193
- created
- —
- last modified
- 2024-09-25T17:02:45+00:00 (2024)
- huggingface
- https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct-FP8
- tags
- transformerssafetensorsllamatext-generationfacebookmetapytorchllama-3conversationalendefritpthiestharxiv:2204.05149base_model:meta-llama/Llama-3.1-405B-Instructbase_model:quantized:meta-llama/Llama-3.1-405B-Instructlicense:llama3.1text-generation-inferenceendpoints_compatiblefbgemm_fp8
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.