HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mellum2-12B-A2.5B-Thinking-GGUF

Mungert/Mellum2-12B-A2.5B-Thinking-GGUF

kind
gguf
quant
gguf (16-bit)
family
misc
modality
text-generation
root model
JetBrains/Mellum2-12B-A2.5B-Thinking
provider
Mungert
license
apache-2.0
language
en
context
131,072
library
transformers
vRAM (GB)
—
size on disk
—
downloads
186
likes
0
created
—
last modified
2026-06-06T20:48:26+00:00 (2026)
huggingface
https://huggingface.co/Mungert/Mellum2-12B-A2.5B-Thinking-GGUF
tags
transformersgguftext-generationenarxiv:2605.31268license:apache-2.0model-indexendpoints_compatibleregion:usconversational

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge84.8MMLU-Reduxmedium| MMLU-Redux | 84.8 | 86.2 | 88.3 | 91.7 | 71.3 | 84.4 |
LiveCodeBenchcoding75.1LiveCodeBench v6medium| LiveCodeBench v6 | 75.1 | 69.9 | 59.4 | 68.3 | 59.8 | 42.7 |
IFEvalinstruction-following69.1IFEvalmedium| IFEval | 69.1 | 76.5 | 87.1 | 89.8 | 84.7 | 59.7 |
BFCL (function calling)agentic60.5BFCL v3medium| BFCL v3 | 60.5 | 69.4 | 73.9 | 68.5 | — | 52.2 |
GPQA Diamondreasoning39.9GPQA Diamondmedium| GPQA Diamond | 39.9 | 57.6 | 76.8 | 81.3 | 29.3 | 46.0 |
BFCL (function calling)agentic38.8BFCL v4medium| BFCL v4 | 38.8 | 45.6 | 42.9 | 42.7 | — | 35.9 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.