HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Mellum2-12B-A2.5B-Instruct-GGUF

Mungert/Mellum2-12B-A2.5B-Instruct-GGUF

kind
gguf
quant
gguf (16-bit)
family
misc
modality
text-generation
root model
JetBrains/Mellum2-12B-A2.5B-Instruct
provider
Mungert
license
apache-2.0
language
en
context
131,072
library
transformers
vRAM (GB)
—
size on disk
—
downloads
478
likes
0
created
—
last modified
2026-06-13T05:24:18+00:00 (2026)
huggingface
https://huggingface.co/Mungert/Mellum2-12B-A2.5B-Instruct-GGUF
tags
transformersgguftext-generationenarxiv:2605.31268license:apache-2.0model-indexendpoints_compatibleregion:usconversational

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge77.4MMLU-Reduxmedium| MMLU-Redux | 77.4 | 78.1 | 87.5 | 91.1 | 71.8 | 85.9 | 38.1 |
EvalPluscoding76.2EvalPlusmedium| EvalPlus | 76.2 | 78.4 | 69.4 | 71.8 | 67.3 | 74.1 | 73.8 |
IFEvalinstruction-following69.3IFEvalmedium| IFEval | 69.3 | 75.8 | 82.1 | 83.9 | 83.2 | 67.3 | 56.2 |
BFCL (function calling)agentic43.1BFCL v3medium| BFCL v3 | 43.1 | 66.3 | 64.1 | 70.5 | 41.9 | 52.7 | — |
GPQA Diamondreasoning38.9GPQA Diamondmedium| GPQA Diamond | 38.9 | 40.9 | 76.8 | 79.8 | 40.9 | 58.6 | 20.2 |
BFCL (function calling)agentic31.8BFCL v4medium| BFCL v4 | 31.8 | 44.2 | 52.0 | 60.6 | 19.8 | 38.8 | — |
LiveCodeBenchcoding30.9LiveCodeBench v6medium| LiveCodeBench v6 | 30.9 | 37.2 | 51.0 | 63.7 | 28.2 | 42.4 | 28.1 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.