HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Olmo-3-1125-32B

allenai/Olmo-3-1125-32B

kind
original
quant
bf16 (16-bit)
family
olmo
modality
text-generation
root model
allenai/Olmo-3-1125-32B
provider
allenai
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
40,111
likes
124
created
—
last modified
2025-12-03T00:26:04+00:00 (2025)
huggingface
https://huggingface.co/allenai/Olmo-3-1125-32B
tags
transformerssafetensorsolmo3text-generationendataset:allenai/dolma3_mix-5.5T-1125license:apache-2.0model-indexendpoints_compatibleregion:us

Benchmark scores (12)

benchmarkcategoryscorecontextconfevidence
PIQAknowledge93.3low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
WinoGrandeknowledge87.5low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
DROPreasoning86.6low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
HellaSwagknowledge86.3low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
BBHreasoning81.1low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
MMLUknowledge79.7low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
MBPPcoding69.8low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
MedQAdomain68.4low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
HumanEvalcoding65.6low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
MATHmath64.7low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
MMLU-Proknowledge61.1low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.
BigCodeBenchcoding48.1low| Qwen-2.5-32B | 64.7 | 48.1 | 65.6 | 8.0 | 43.3 | 69.8 | 49.7 | 53.6 | 48.3 | 97.0 | 79.7 | 68.8 | 68.4 | 97.1 | 82.2 | 85.0 | 88.4 | 81.2 | 89.9 | 93.3 | 86.6 | 96.8 | 86.6 | 97.

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.