HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMoE-1B-7B-0125

allenai/OLMoE-1B-7B-0125

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
allenai/OLMoE-1B-7B-0125
provider
allenai
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
26,274
likes
38
created
—
last modified
2025-03-16T15:13:11+00:00 (2025)
huggingface
https://huggingface.co/allenai/OLMoE-1B-7B-0125
tags
transformerssafetensorsolmoetext-generationmoeolmoendataset:allenai/OLMoE-mix-0924dataset:allenai/dolmino-mix-1124arxiv:2409.02060license:apache-2.0co2_eq_emissionsendpoints_compatibleregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge81.7Open Datalow| **OLMoE-1B-7B-0125** | **1.3B** | **✅** | **56.3** | **81.7** | **67.5** | **84.4** | 78.7 | **70.6** |
PIQAknowledge78.7Open Datalow| **OLMoE-1B-7B-0125** | **1.3B** | **✅** | **56.3** | **81.7** | **67.5** | **84.4** | 78.7 | **70.6** |
WinoGrandeknowledge70.6Open Datalow| **OLMoE-1B-7B-0125** | **1.3B** | **✅** | **56.3** | **81.7** | **67.5** | **84.4** | 78.7 | **70.6** |
MMLUknowledge56.3Open Datalow| **OLMoE-1B-7B-0125** | **1.3B** | **✅** | **56.3** | **81.7** | **67.5** | **84.4** | 78.7 | **70.6** |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.