OLMo-2-1124-7B-SFT

Home/Models/allenai/OLMo-2-1124-7B-SFT

allenai/OLMo-2-1124-7B-SFT

kind: original
quant: bf16 (16-bit)
family: olmo
modality: text-generation
root model: allenai/OLMo2-7B-1124
provider: allenai
license: apache-2.0
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 15,408
likes: 1
created: —
last modified: 2025-01-06T01:03:35+00:00 (2025)
huggingface: https://huggingface.co/allenai/OLMo-2-1124-7B-SFT
tags: transformerspytorcholmo2text-generationconversationalendataset:allenai/tulu-3-sft-olmo-2-mixturearxiv:2501.00656arxiv:2411.15124base_model:allenai/OLMo-2-1124-7Bbase_model:finetune:allenai/OLMo-2-1124-7Blicense:apache-2.0endpoints_compatibleregion:us

benchmark	category	score	conf	evidence
GSM8K	math	79.7	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
IFEval	instruction-following	69.9	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
MMLU	knowledge	69.1	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
DROP	reasoning	58.8	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
AlpacaEval	chat	43.7	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
MATH	math	29.8	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
PopQA	knowledge	28.3	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`
BBH	reasoning	2.5	low	`\| Gemma-2-9B-it \| 51.9 \| 43.7 \| 2.5 \| 58.8 \| 79.7 \| 69.9 \| 29.8 \| 69.1 \| 75.5 \| 28.3 \| 61.4 \|`

none scraped.