HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMoE-1B-7B-0924

allenai/OLMoE-1B-7B-0924

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
allenai/OLMoE-1B-7B-0924
provider
allenai
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
185,706
likes
146
created
—
last modified
2024-10-19T04:24:22+00:00 (2024)
huggingface
https://huggingface.co/allenai/OLMoE-1B-7B-0924
tags
transformerssafetensorsolmoetext-generationmoeolmoendataset:allenai/OLMoE-mix-0924arxiv:2409.02060license:apache-2.0co2_eq_emissionsendpoints_compatibleregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge80.0Open Datalow| **OLMoE-1B-7B** | **1.3B** | **✅** | **54.1** | **80.0** | **62.1** | **84.2** | **79.8** | **70.2** |
PIQAknowledge79.8Open Datalow| **OLMoE-1B-7B** | **1.3B** | **✅** | **54.1** | **80.0** | **62.1** | **84.2** | **79.8** | **70.2** |
WinoGrandeknowledge70.2Open Datalow| **OLMoE-1B-7B** | **1.3B** | **✅** | **54.1** | **80.0** | **62.1** | **84.2** | **79.8** | **70.2** |
MMLUknowledge54.1Open Datalow| **OLMoE-1B-7B** | **1.3B** | **✅** | **54.1** | **80.0** | **62.1** | **84.2** | **79.8** | **70.2** |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.