Mistral-Nemo-12B-ArliAI-RPMax-v1.1

Home/Models/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1

ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1

kind: original
quant: bf16 (16-bit)
family: mistral
modality: —
root model: ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1
provider: ArliAI
license: apache-2.0
language: —
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 219
likes: 47
created: —
last modified: 2024-10-12T13:04:51+00:00 (2024)
huggingface: https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1
tags: safetensorsmistrallicense:apache-2.0model-indexregion:us

benchmark	category	score	context	conf	evidence
IFEval	instruction-following	53.49	IFEval (0-Shot)	medium	`\| IFEval (0-Shot) \| 53.49 \|`
MMLU-Pro	knowledge	26.49	MMLU-PRO (5-shot)	medium	`\| MMLU-PRO (5-shot) \| 26.49 \|`
BBH	reasoning	24.81	BBH (3-Shot)	medium	`\| BBH (3-Shot) \| 24.81 \|`
MATH	math	9.21	MATH Lvl 5 (4-Shot)	medium	`\| MATH Lvl 5 (4-Shot) \| 9.21 \|`
MUSR	reasoning	5.56	MuSR (0-shot)	medium	`\| MuSR (0-shot) \| 5.56 \|`
GPQA	reasoning	4.25	GPQA (0-shot)	medium	`\| GPQA (0-shot) \| 4.25 \|`

none scraped.