Llama-3.1-405B-FP8
meta-llama/Llama-3.1-405B-FP8
- kind
- fp8
- quant
- fp8 (8-bit)
- family
- llama
- modality
- text-generation
- root model
- meta-llama/Llama-3.1-405B-Instruct
- provider
- meta-llama
- license
- llama3.1
- language
- en, de, fr, it, pt, hi, es, th
- context
- —
- library
- transformers
- vRAM (GB)
- —
- size on disk
- —
- downloads
- 402,157
- likes
- 123
- created
- —
- last modified
- 2024-12-06T19:41:17+00:00 (2024)
- huggingface
- https://huggingface.co/meta-llama/Llama-3.1-405B-FP8
- tags
- transformerssafetensorsllamatext-generationfacebookmetapytorchllama-3endefritpthiestharxiv:2204.05149license:llama3.1text-generation-inferenceendpoints_compatiblefbgemm_fp8region:usdeploy:sagemaker
Benchmark scores (0)
no scores extracted for this variant.
Discussions (0)
none scraped.