AceInstruct-1.5B

Home/Models/nvidia/AceInstruct-1.5B

nvidia/AceInstruct-1.5B

kind: original
quant: bf16 (16-bit)
family: misc
modality: text-generation
root model: nvidia/AceInstruct-1.5B
provider: nvidia
license: cc-by-nc-4.0
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 150
likes: 22
created: —
last modified: 2025-01-16T14:17:25+00:00 (2025)
huggingface: https://huggingface.co/nvidia/AceInstruct-1.5B
tags: safetensorsqwen2nvidiaAceInstructcodemathgeneral_domaininstruct_modelpytorchtext-generationconversationalenarxiv:2412.15084license:cc-by-nc-4.0region:us

benchmark	category	score	context	conf	evidence
GSM8K	math	73.2	GSM8K	medium	`\| GSM8K \| 73.20 \| 80.44 \| 91.60 \| 93.10 \| 95.80 \| 96.36 \|`
MBPP	coding	63.2	MBPP	medium	`\| MBPP \| 63.20 \| 65.76 \| 79.20 \| 74.32 \| 88.20 \| 83.66 \|`
HumanEval	coding	61.6	HumanEval	medium	`\| HumanEval \| 61.60 \| 73.17 \| 84.80 \| 85.37 \| 86.60 \| 89.63 \|`
MMLU	knowledge	58.37	MMLU	medium	`\| MMLU \| 58.37 \| 58.17 \| 74.51 \| 74.68 \| 84.67 \| 83.88 \|`
MATH	math	55.2	MATH	medium	`\| MATH \| 55.20 \| 60.34 \| 75.50 \| 76.40 \| 83.10 \| 84.50 \|`
MMLU-Pro	knowledge	32.4	MMLU Pro	medium	`\| MMLU Pro \| 32.40 \| 33.78 \| 56.30 \| 54.50 \| 71.10 \| 66.10 \|`

none scraped.