HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/JetBrains/JetBrains/Mellum2-12B-A2.5B-Thinking

JetBrains/Mellum2-12B-A2.5B-Thinking

family misc · 2 variants · unknown

provider
JetBrains
released
—
huggingface
https://huggingface.co/JetBrains/Mellum2-12B-A2.5B-Thinking
best scores
LiveCodeBench: 75.1BFCL (function calling): 60.5MMLU: 84.8GPQA Diamond: 39.9IFEval: 69.1

Best scores per benchmark

benchmarkcategorybest score
MMLUknowledge84.8
LiveCodeBenchcoding75.1
IFEvalinstruction-following69.1
BFCL (function calling)agentic60.5
GPQA Diamondreasoning39.9

Variants (2)

variantkindquantbitsvRAMdlorgyear
Mellum2-12B-A2.5B-Thinking-GGUFggufgguf2.02,330bartowski2026
Mellum2-12B-A2.5B-Thinking-GGUFggufgguf16.0186Mungert2026
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.