HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/psmathur/psmathur/orca_mini_v3_7b

psmathur/orca_mini_v3_7b

family misc · 2 variants · unknown

provider: psmathur
released: —
huggingface: https://huggingface.co/psmathur/orca_mini_v3_7b
best scores: ARC-Challenge: 57.17HellaSwag: 79.66MMLU: 52.34TruthfulQA: 50.29

Best scores per benchmark

benchmark	category	best score
HellaSwag	knowledge	79.66
ARC-Challenge	knowledge	57.17
MMLU	knowledge	52.34
TruthfulQA	safety	50.29

Variants (2)

variant	kind	quant	bits	vRAM	dl	org	year
orca_mini_v3_7B-GGUF	gguf	gguf	2.0		1,338	TheBloke	2023
orca_mini_v3_7B-GPTQ	gptq	gptq			69	TheBloke	2023

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.