HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/mistralai/mistralai/Mistral-Nemo-Base-2407

mistralai/Mistral-Nemo-Base-2407

family mistral · 10 variants · unknown

provider
mistralai
released
—
huggingface
https://huggingface.co/mistralai/Mistral-Nemo-Base-2407
best scores
HellaSwag: 83.5WinoGrande: 76.8OpenBookQA: 60.6CommonsenseQA: 70.4TruthfulQA: 50.3MMLU: 68.0TriviaQA: 73.8GPQA Diamond: 57.1

Best scores per benchmark

benchmarkcategorybest score
HellaSwagknowledge83.5
WinoGrandeknowledge76.8
TriviaQAknowledge73.8
CommonsenseQAknowledge70.4
MMLUknowledge68.0
OpenBookQAknowledge60.6
GPQA Diamondreasoning57.1
TruthfulQAsafety50.3

Variants (10)

variantkindquantbitsvRAMdlorgyear
Mistral-Nemo-Instruct-2407originalbf1616.0425,504mistralai2025
Mistral-Nemo-Base-2407originalbf1616.049,619mistralai2025
Mistral-Nemo-Instruct-2407-bnb-4bitbnb-4bit4bit7,410unsloth2025
Mistral-Nemo-Base-2407-bnb-4bitbnb-4bit4bit1,831unsloth2025
Mistral-Nemo-Base-2407-i1-GGUFggufgguf1.0997mradermacher2025
Mistral-Nemo-Base-2407originalbf1616.0533unsloth2025
Homunculus-GGUFggufgguf16.0201Mungert2025
Wayfarer-2-12B-GGUFggufgguf16.0121Mungert2025
Mistral-Nemo-Instruct-FP8-2407fp8fp88.0115mistralai2025
lucid-v1-nemo-GGUFggufgguf16.024Mungert2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.