HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMo-2-0325-32B-Instruct-GGUF

unsloth/OLMo-2-0325-32B-Instruct-GGUF

kind
gguf
quant
gguf (16-bit)
family
olmo
modality
text-generation
root model
allenai/OLMo-2-0325-32B-Instruct
provider
unsloth
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
1,198
likes
12
created
—
last modified
2025-03-14T01:58:09+00:00 (2025)
huggingface
https://huggingface.co/unsloth/OLMo-2-0325-32B-Instruct-GGUF
tags
transformersggufolmo2text-generationendataset:allenai/tulu-3-sft-olmo-2-mixturearxiv:2501.00656arxiv:2411.15124base_model:allenai/OLMo-2-0325-32B-Instructbase_model:quantized:allenai/OLMo-2-0325-32B-Instructlicense:apache-2.0endpoints_compatibleregion:usconversational

Benchmark scores (8)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath74.3low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
DROPreasoning70.2low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
MMLUknowledge70.2low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
IFEvalinstruction-following66.9low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
BBHreasoning66.6low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
PopQAknowledge45.0low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
MATHmath41.2low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |
AlpacaEvalchat38.7low| GPT-3.5 Turbo 0125 | 59.6 | 38.7 | 66.6 | 70.2 | 74.3 | 66.9 | 41.2 | 70.2 | 69.1 | 45.0 | 62.9 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.