HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/mistralai/mistralai/Mistral-Small-24B-Base-2501

mistralai/Mistral-Small-24B-Base-2501

family mistral · 5 variants · unknown

provider
mistralai
released
—
huggingface
https://huggingface.co/mistralai/Mistral-Small-24B-Base-2501
best scores
MMLU-Pro: 66.3GPQA-Main: 45.3HumanEval: 84.8MT-Bench: 8.35WildBench: 52.27Chatbot Arena: 87.3IFEval: 82.9MMLU: 80.73GPQA: 34.37TriviaQA: 80.32MBPP: 69.64GSM8K: 80.73MATH: 45.98AGIEval: 65.8

Best scores per benchmark

benchmarkcategorybest score
Chatbot Arenachat87.3
HumanEvalcoding84.8
IFEvalinstruction-following82.9
MMLUknowledge80.73
GSM8Kmath80.73
TriviaQAknowledge80.32
MBPPcoding69.64
MMLU-Proknowledge66.3
AGIEvalreasoning65.8
WildBenchchat52.27
MATHmath45.98
GPQA-Mainreasoning45.3
GPQAreasoning34.37
MT-Benchchat8.35

Variants (5)

variantkindquantbitsvRAMdlorgyear
Voxtral-Small-24B-2507originalbf1616.0246,173mistralai2025
Mistral-Small-24B-Instruct-2501originalbf1616.085,437mistralai2025
Mistral-Small-24B-Base-2501originalbf1616.03,652mistralai2025
mistralai_Mistral-Small-24B-Base-2501-GGUFggufgguf2.0527bartowski2025
Mistral-Small-24B-Base-2501-unsloth-bnb-4bitbnb-4bit4bit152unsloth2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.