HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMo-2-1124-13B-Instruct

allenai/OLMo-2-1124-13B-Instruct

kind
original
quant
bf16 (16-bit)
family
olmo
modality
text-generation
root model
allenai/OLMo-2-1124-13B-Instruct-RLVR2
provider
allenai
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
17,434
likes
48
created
—
last modified
2025-01-06T01:02:18+00:00 (2025)
huggingface
https://huggingface.co/allenai/OLMo-2-1124-13B-Instruct
tags
transformerssafetensorsolmo2text-generationconversationalendataset:allenai/RLVR-MATHarxiv:2501.00656arxiv:2411.15124base_model:allenai/OLMo-2-1124-13B-Instruct-RLVR2base_model:finetune:allenai/OLMo-2-1124-13B-Instruct-RLVR2license:apache-2.0endpoints_compatibleregion:us

Benchmark scores (8)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath79.7low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
IFEvalinstruction-following69.9low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
MMLUknowledge69.1low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
DROPreasoning58.8low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
AlpacaEvalchat43.7low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
MATHmath29.8low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
PopQAknowledge28.3low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |
BBHreasoning2.5low| Gemma-2-9B-it | 51.9 | 43.7 | 2.5 | 58.8 | 79.7 | 69.9 | 29.8 | 69.1 | 75.5 | 28.3 | 61.4 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.