HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Llama-3.1-8B-ArliAI-RPMax-v1.1

ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1

kind
original
quant
bf16 (16-bit)
family
llama
modality
text-generation
root model
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1
provider
ArliAI
license
llama3
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
13
likes
30
created
—
last modified
2024-10-12T18:04:44+00:00 (2024)
huggingface
https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1
tags
transformerssafetensorsllamatext-generationconversationallicense:llama3model-indextext-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
IFEvalinstruction-following63.59IFEval (0-Shot)medium| IFEval (0-Shot) | 63.59 |
BBHreasoning28.79BBH (3-Shot)medium| BBH (3-Shot) | 28.79 |
MMLU-Proknowledge28.35MMLU-PRO (5-shot)medium| MMLU-PRO (5-shot) | 28.35 |
MATHmath11.33MATH Lvl 5 (4-Shot)medium| MATH Lvl 5 (4-Shot) | 11.33 |
MUSRreasoning5.31MuSR (0-shot)medium| MuSR (0-shot) | 5.31 |
GPQAreasoning4.47GPQA (0-shot)medium| GPQA (0-shot) | 4.47 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.