HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

kind
bnb-4bit
quant
4bit
family
llama
modality
text-generation
root model
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
provider
unsloth
license
llama3.1
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
257
likes
20
created
—
last modified
2024-10-17T04:56:25+00:00 (2024)
huggingface
https://huggingface.co/unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit
tags
transformerssafetensorsllamatext-generationnvidiallama3.1unslothconversationalendataset:nvidia/HelpSteer2base_model:nvidia/Llama-3.1-Nemotron-70B-Instruct-HFbase_model:quantized:nvidia/Llama-3.1-Nemotron-70B-Instruct-HFlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitbitsandbytesregion:us

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.