OLMo-2-0325-32B-Instruct

Home/Models/allenai/OLMo-2-0325-32B-Instruct

allenai/OLMo-2-0325-32B-Instruct

kind: original
quant: bf16 (16-bit)
family: olmo
modality: text-generation
root model: allenai/OLMo-2-0325-32B-DPO
provider: allenai
license: apache-2.0
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 7,256
likes: 147
created: —
last modified: 2025-03-14T22:45:15+00:00 (2025)
huggingface: https://huggingface.co/allenai/OLMo-2-0325-32B-Instruct
tags: transformerssafetensorsolmo2text-generationconversationalendataset:allenai/RLVR-GSM-MATH-IF-Mixed-Constraintsarxiv:2501.00656arxiv:2411.15124base_model:allenai/OLMo-2-0325-32B-DPObase_model:finetune:allenai/OLMo-2-0325-32B-DPOlicense:apache-2.0endpoints_compatibledeploy:azureregion:us

benchmark	category	score	conf	evidence
GSM8K	math	74.3	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
DROP	reasoning	70.2	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
MMLU	knowledge	70.2	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
IFEval	instruction-following	66.9	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
BBH	reasoning	66.6	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
PopQA	knowledge	45.0	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
MATH	math	41.2	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`
AlpacaEval	chat	38.7	low	`\| GPT-3.5 Turbo 0125 \| 59.6 \| 38.7 \| 66.6 \| 70.2 \| 74.3 \| 66.9 \| 41.2 \| 70.2 \| 69.1 \| 45.0 \| 62.9 \|`

none scraped.