OLMo-2-1124-13B-Instruct-preview

Home/Models/allenai/OLMo-2-1124-13B-Instruct-preview

allenai/OLMo-2-1124-13B-Instruct-preview

kind: original
quant: bf16 (16-bit)
family: olmo
modality: text-generation
root model: allenai/OLMo-2-1124-13B-DPO
provider: allenai
license: apache-2.0
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 56
likes: 58
created: —
last modified: 2025-01-06T19:51:02+00:00 (2025)
huggingface: https://huggingface.co/allenai/OLMo-2-1124-13B-Instruct-preview
tags: transformerssafetensorsolmo2text-generationconversationalendataset:allenai/RLVR-GSM-MATH-IF-Mixed-Constraintsarxiv:2411.15124arxiv:2501.00656base_model:allenai/OLMo-2-1124-13B-DPObase_model:finetune:allenai/OLMo-2-1124-13B-DPOlicense:apache-2.0endpoints_compatibleregion:us

benchmark	category	score	conf	evidence
GSM8K	math	79.7	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
IFEval	instruction-following	69.9	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
MMLU	knowledge	69.1	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
DROP	reasoning	58.8	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
AlpacaEval	chat	43.7	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
MATH	math	29.8	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
PopQA	knowledge	28.3	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
BBH	reasoning	2.5	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`

none scraped.