HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Home/Orgs/jondurbin/jondurbin/bagel-dpo-7b-v0.1

jondurbin/bagel-dpo-7b-v0.1

family misc · 1 variants · unknown

provider: jondurbin
released: —
huggingface: https://huggingface.co/jondurbin/bagel-dpo-7b-v0.1
best scores: BoolQ: 88.13HellaSwag: 83.97ARC-Challenge: 64.76GSM8K: 48.52MMLU: 63.47OpenBookQA: 49.8PIQA: 84.0WinoGrande: 74.43

Best scores per benchmark

benchmark	category	best score
BoolQ	knowledge	88.13
PIQA	knowledge	84.0
HellaSwag	knowledge	83.97
WinoGrande	knowledge	74.43
ARC-Challenge	knowledge	64.76
MMLU	knowledge	63.47
OpenBookQA	knowledge	49.8
GSM8K	math	48.52

Variants (1)

variant	kind	quant	bits	vRAM	dl	org	year
bagel-dpo-7B-v0.1-GGUF	gguf	gguf	2.0		264	TheBloke	2023

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.