HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Olmo-3.1-32B-Think-GGUF

unsloth/Olmo-3.1-32B-Think-GGUF

kind
gguf
quant
gguf (16-bit)
family
olmo
modality
—
root model
allenai/Olmo-3.1-32B-Think
provider
unsloth
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
1,187
likes
9
created
—
last modified
2025-12-17T04:19:35+00:00 (2025)
huggingface
https://huggingface.co/unsloth/Olmo-3.1-32B-Think-GGUF
tags
transformersggufunslothendataset:allenai/Dolci-Think-RLbase_model:allenai/Olmo-3.1-32B-Thinkbase_model:quantized:allenai/Olmo-3.1-32B-Thinklicense:apache-2.0endpoints_compatibleregion:usimatrixconversational

Benchmark scores (14)

benchmarkcategoryscorecontextconfevidence
MATHmath96.2MATHmedium| MATH | 96.2 | 95.6 | 95.9 | 96.1 | 95.4 | 96.7 | 80.2 | 87.4 | 51.5 | 49.2 | 92.6 |
IFEvalinstruction-following93.8IFEvalmedium| IFEval | 93.8 | 83.9 | 80.6 | 89.0 | 86.5 | 85.5 | 81.9 | 85.4 | 62.1 | 85.8 | 78.7 |
HumanEvalcoding91.5HumanEvalPlusmedium| HumanEvalPlus | 91.5 | 90.0 | 91.6 | 91.4 | 91.2 | 90.6 | 82.6 | 79.2 | 67.5 | 44.4 | 92.3 |
AGIEvalreasoning89.2AGI Eval Englishmedium| AGI Eval English | 89.2 | 85.9 | 87.8 | 88.2 | 90.0 | 92.2 | 78.9 | 76.9 | 70.9 | 68.4 | 88.1 |
BBHreasoning88.6BigBenchHardmedium| BigBenchHard | 88.6 | 88.8 | 89.1 | 89.8 | 90.6 | 91.1 | 80.9 | 82.4 | 66.0 | 65.6 | 89.7 |
MMLUknowledge86.4MMLUmedium| MMLU | 86.4 | 85.3 | 85.2 | 85.4 | 88.8 | 90.1 | 84.6 | 74.6 | 76.1 | 77.1 | 88.0 |
LiveCodeBenchcoding83.3LiveCodeBench v3medium| LiveCodeBench v3 | 83.3 | 75.8 | 81.9 | 83.5 | 90.2 | 84.8 | 49.9 | 39.0 | 28.7 | 10.6 | 79.5 |
AIME 2024math80.6AIME 2024medium| AIME 2024 | 80.6 | 73.5 | 76.0 | 76.8 | 80.8 | 86.3 | 15.7 | 28.9 | 4.7 | 4.6 | 70.3 |
AIME 2025math78.1AIME 2025medium| AIME 2025 | 78.1 | 66.2 | 70.7 | 72.5 | 70.9 | 78.8 | 13.4 | 22.9 | 0.9 | 0.9 | 56.3 |
AlpacaEvalchat69.1AlpacaEval 2 LCmedium| AlpacaEval 2 LC | 69.1 | 69.1 | 78.6 | 74.2 | 75.6 | 80.9 | 81.9 | 65.5 | 39.8 | 38.0 | 26.2 |
MBPPcoding68.3MBPP+medium| MBPP+ | 68.3 | 66.7 | 67.2 | 68.0 | 70.6 | 66.2 | 66.6 | 65.7 | 61.2 | 49.0 | 70.1 |
IFBenchinstruction-following68.1IFBenchmedium| IFBench | 68.1 | 37.0 | 34.4 | 47.6 | 37.3 | 55.1 | 36.7 | 31.3 | 27.8 | 36.4 | 23.8 |
GPQAreasoning57.5GPQAmedium| GPQA | 57.5 | 55.7 | 57.6 | 58.1 | 67.3 | 67.4 | 44.6 | 45.0 | 39.9 | 36.4 | 61.8 |
PopQAknowledge30.9PopQAmedium| PopQA | 30.9 | 33.1 | 37.0 | 31.9 | 30.7 | 32.2 | 28.0 | 30.2 | 30.4 | 37.2 | 26.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.