HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mistral-Nemo-Instruct-FP8-2407

mistralai/Mistral-Nemo-Instruct-FP8-2407

kind
fp8
quant
fp8 (8-bit)
family
mistral
modality
—
root model
mistralai/Mistral-Nemo-Base-2407
provider
mistralai
license
apache-2.0
language
en, fr, de, es, it, pt, ru, zh, ja
context
—
library
vllm
vRAM (GB)
—
size on disk
—
downloads
115
likes
26
created
—
last modified
2025-07-28T17:26:56+00:00 (2025)
huggingface
https://huggingface.co/mistralai/Mistral-Nemo-Instruct-FP8-2407
tags
vllmmistral-commonenfrdeesitptruzhjabase_model:mistralai/Mistral-Nemo-Base-2407base_model:finetune:mistralai/Mistral-Nemo-Base-2407license:apache-2.0region:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge83.5HellaSwag (0-shot)medium| HellaSwag (0-shot) | 83.5% |
WinoGrandeknowledge76.8Winogrande (0-shot)medium| Winogrande (0-shot) | 76.8% |
TriviaQAknowledge73.8TriviaQA (5-shot)medium| TriviaQA (5-shot) | 73.8% |
CommonsenseQAknowledge70.4CommonSenseQA (0-shot)medium| CommonSenseQA (0-shot) | 70.4% |
MMLUknowledge68.0MMLU (5-shot)medium| MMLU (5-shot) | 68.0% |
OpenBookQAknowledge60.6OpenBookQA (0-shot)medium| OpenBookQA (0-shot) | 60.6% |
TruthfulQAsafety50.3TruthfulQA (0-shot)medium| TruthfulQA (0-shot) | 50.3% |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.