HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mixtral-8x7B-Instruct-v0.1-AWQ-INT4

hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4

kind
awq
quant
awq
family
mistral
modality
text-generation
root model
mistralai/Mixtral-8x7B-Instruct-v0.1
provider
hugging-quants
license
apache-2.0
language
fr, it, de, es, en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
15,496
likes
0
created
—
last modified
2024-10-07T06:59:00+00:00 (2024)
huggingface
https://huggingface.co/hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4
tags
transformerssafetensorsmixtraltext-generationautoawqconversationalfritdeesenlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bitawqdeploy:azureregion:us

Benchmark scores (0)

no scores extracted for this variant.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.