HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OLMo-7B-0424-Instruct-hf

allenai/OLMo-7B-0424-Instruct-hf

kind
original
quant
bf16 (16-bit)
family
olmo
modality
text-generation
root model
allenai/OLMo-7B-0424-Instruct-hf
provider
allenai
license
apache-2.0
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
60
likes
1
created
—
last modified
2024-07-14T17:41:10+00:00 (2024)
huggingface
https://huggingface.co/allenai/OLMo-7B-0424-Instruct-hf
tags
transformerssafetensorsolmotext-generationconversationalendataset:allenai/dolmadataset:allenai/tulu-v2-sft-mixture-olmo-4096dataset:allenai/ultrafeedback_binarized_cleanedarxiv:2402.00838license:apache-2.0endpoints_compatibleregion:us

Benchmark scores (3)

benchmarkcategoryscorecontextconfevidence
AlpacaEvalchat70.4low| **[OLMo 7B April 2024 SFT](https://huggingface.co/allenai/OLMo-1.7-7B-SFT-hf)** | 52.4 | 70.4 | 0.5 | 38.8 |
MMLUknowledge47.5low| **OLMo 7B April 2024 base** | 47.5 | - | 83.2 | 25.7 |
TruthfulQAsafety25.7low| **OLMo 7B April 2024 base** | 47.5 | - | 83.2 | 25.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.