OLMo-1B

Home/Models/allenai/OLMo-1B

allenai/OLMo-1B

kind: original
quant: bf16 (16-bit)
family: olmo
modality: text-generation
root model: allenai/OLMo-1B
provider: allenai
license: apache-2.0
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 467
likes: 108
created: —
last modified: 2024-07-16T18:02:54+00:00 (2024)
huggingface: https://huggingface.co/allenai/OLMo-1B
tags: transformerspytorchsafetensorshf_olmotext-generationcustom_codeendataset:allenai/dolmaarxiv:2402.00838arxiv:2302.13971license:apache-2.0region:us

benchmark	category	score	context	conf	evidence
PIQA	knowledge	76.3		medium	`\| piqa \| 76.3 \| 76.4 \| 78.5 \| 77.3 \| 78.4 \|`
HellaSwag	knowledge	74.5		medium	`\| hellaswag \| 74.5 \| 74.5 \| 75.9 \| 77.6 \| 76.4 \|`
BoolQ	knowledge	73.1		medium	`\| boolq \| 73.1 \| 73.5 \| 74.6 \| 74.2 \| 73.4 \|`
WinoGrande	knowledge	68.2		medium	`\| winogrande \| 68.2 \| 67.3 \| 68.9 \| 69.9 \| 67.9 \|`
OpenBookQA	knowledge	49.8		medium	`\| openbookqa \| 49.8 \| 48.4 \| 53.0 \| 48.6 \| 50.2 \|`
ARC-Challenge	knowledge	44.5	_challenge	medium	`\| arc_challenge \| 44.5 \| 39.8 \| 47.5 \| 46.5 \| 48.5 \|`
TruthfulQA	safety	33.9	truthfulQA (MC2)	medium	`\| truthfulQA (MC2) \| 33.9 \| 38.5 \| 34.0 \| 33 \| 36.0 \|`
MMLU	knowledge	31.5	MMLU (5 shot MC)	medium	`\| MMLU (5 shot MC) \| 31.5 \| 45.0 \| 24.0 \| 30.8 \| 28.3 \|`

none scraped.