HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mistral-Small-3.2-24B-Instruct-2506-FP8

unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8

kind
fp8
quant
fp8 (8-bit)
family
mistral
modality
image-text-to-text
root model
mistralai/Mistral-Small-3.2-24B-Instruct-2506
provider
unsloth
license
apache-2.0
language
en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa
context
128K
library
vllm
vRAM (GB)
—
size on disk
—
downloads
74
likes
6
created
—
last modified
2025-06-21T14:16:53+00:00 (2025)
huggingface
https://huggingface.co/unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8
tags
vllmimage-text-to-textenfrdeesptitjakoruzharfaidmsneplrosrsvtrukvi

Benchmark scores (14)

benchmarkcategoryscorecontextconfevidence
DocVQAmultimodal94.08low| Small 3.1 24B Instruct | **64.00%** | **68.91%** | 86.24% | 94.08% | 93.72% |
HumanEvalcoding88.99MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
ChartQAmultimodal86.24low| Small 3.1 24B Instruct | **64.00%** | **68.91%** | 86.24% | 94.08% | 93.72% |
MMLUknowledge80.62MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
MBPPcoding74.63MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
MATHmath69.3MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
MathVistamultimodal68.91low| Small 3.1 24B Instruct | **64.00%** | **68.91%** | 86.24% | 94.08% | 93.72% |
MMLU-Proknowledge66.76MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
MMMUmultimodal64.0low| Small 3.1 24B Instruct | **64.00%** | **68.91%** | 86.24% | 94.08% | 93.72% |
WildBenchchat55.6low| Small 3.1 24B Instruct | 55.6% | 19.56% | 82.75% |
GPQA Diamondreasoning45.96MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
GPQAreasoning44.42MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |
Chatbot Arenachat19.56low| Small 3.1 24B Instruct | 55.6% | 19.56% | 82.75% |
SimpleQAknowledge10.43MMLU Pro (5-shot CoT) | GPQA Main (5-shot CoT) | GPQA Diamond (5-shot CoT )low| Small 3.1 24B Instruct | 80.62% | 66.76% | 69.30% | 44.42% | 45.96% | 74.63% | 88.99% | 10.43% |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.