HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

bagel-dpo-7B-v0.1-GGUF

TheBloke/bagel-dpo-7B-v0.1-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
—
root model
jondurbin/bagel-dpo-7b-v0.1
provider
TheBloke
license
apache-2.0
language
—
context
32768,
library
—
vRAM (GB)
—
size on disk
—
downloads
264
likes
5
created
—
last modified
2023-12-13T19:03:08+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/bagel-dpo-7B-v0.1-GGUF
tags
transformersggufmistraldataset:ai2_arcdataset:unalignment/spicy-3.1dataset:codeparrot/appsdataset:facebook/belebeledataset:boolqdataset:jondurbin/cinematika-v0.1dataset:dropdataset:lmsys/lmsys-chat-1mdataset:TIGER-Lab/MathInstructdataset:cais/mmludataset:Muennighoff/natural-instructionsdataset:openbookqadataset:piqadataset:Vezora/Tested-22k-Python-Alpacadataset:cakiki/rosetta-codedataset:Open-Orca/SlimOrcadataset:spiderdataset:squad_v2dataset:migtissera/Synthia-v1.3dataset:datasets/winograndedataset:nvidia/HelpSteer

Benchmark scores (8)

benchmarkcategoryscorecontextconfevidence
BoolQknowledge88.13high| bagel | __0.6715__ | 0.8813 | __0.5618__ | 0.8397 | __0.6408__ | __0.51__ | __0.8406__ | __0.6275__ | __0.7561__ |
PIQAknowledge84.0low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |
HellaSwagknowledge83.97high| bagel | __0.6715__ | 0.8813 | __0.5618__ | 0.8397 | __0.6408__ | __0.51__ | __0.8406__ | __0.6275__ | __0.7561__ |
WinoGrandeknowledge74.43low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |
ARC-Challengeknowledge64.76low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |
MMLUknowledge63.47low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |
OpenBookQAknowledge49.8low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |
GSM8Kmath48.52low| openhermes-2.5 | 0.6476 | __0.8835__ | 0.4852 | __0.8414__ | 0.6347 | 0.498 | 0.8400 | 0.5295 | 0.7443 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.