HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/JetBrains/JetBrains/Mellum2-12B-A2.5B-Instruct

JetBrains/Mellum2-12B-A2.5B-Instruct

family misc · 3 variants · unknown

provider
JetBrains
released
—
huggingface
https://huggingface.co/JetBrains/Mellum2-12B-A2.5B-Instruct
best scores
LiveCodeBench: 30.9EvalPlus: 76.2BFCL (function calling): 43.1MMLU: 77.4GPQA Diamond: 38.9IFEval: 69.3

Best scores per benchmark

benchmarkcategorybest score
MMLUknowledge77.4
EvalPluscoding76.2
IFEvalinstruction-following69.3
BFCL (function calling)agentic43.1
GPQA Diamondreasoning38.9
LiveCodeBenchcoding30.9

Variants (3)

variantkindquantbitsvRAMdlorgyear
Mellum2-12B-A2.5B-Instruct-GGUFggufgguf2.01,379bartowski2026
Mellum2-12B-A2.5B-Instruct-i1-GGUFggufgguf1.01,213mradermacher2026
Mellum2-12B-A2.5B-Instruct-GGUFggufgguf16.0478Mungert2026
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.