HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Meta-Llama-3.1-405B-Instruct-BNB-NF4

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

kind
bnb-4bit
quant
4bit
family
llama
modality
text-generation
root model
meta-llama/Meta-Llama-3.1-405B-Instruct
provider
hugging-quants
license
llama3.1
language
en, de, fr, it, pt, hi, es, th
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
42
likes
5
created
—
last modified
2024-09-16T23:46:54+00:00 (2024)
huggingface
https://huggingface.co/hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4
tags
transformerssafetensorsllamatext-generationllama-3.1metabnbconversationalendefritpthiesthbase_model:meta-llama/Llama-3.1-405B-Instructbase_model:quantized:meta-llama/Llama-3.1-405B-Instructlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitbitsandbytesregion:us

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.