DPOpenHermes-7B-GGUF

Home/Models/TheBloke/DPOpenHermes-7B-GGUF

DPOpenHermes-7B-GGUF

TheBloke/DPOpenHermes-7B-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: text-generation
root model: openaccess-ai-collective/DPOpenHermes-7B
provider: TheBloke
license: apache-2.0
language: en
context: 32768,
library: transformers
vRAM (GB): —
size on disk: —
downloads: 360
likes: 5
created: —
last modified: 2023-12-03T03:46:34+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/DPOpenHermes-7B-GGUF
tags: transformersggufmistraltext-generationendataset:teknium/openhermesdataset:argilla/ultrafeedback-binarized-preferencesdataset:Intel/orca_dpo_pairsbase_model:openaccess-ai-collective/DPOpenHermes-7Bbase_model:quantized:openaccess-ai-collective/DPOpenHermes-7Blicense:apache-2.0region:usconversational

Benchmark scores (33)

benchmark	category	score	context	conf	evidence
BoolQ	knowledge	85.99		medium	`\| boolq \| 1 \| acc \| 0.8599 \| _ \| 0.0061 \|`
PIQA	knowledge	81.99		medium	`\| piqa \| 0 \| acc \| 0.8199 \| _ \| 0.0090 \|`
WinoGrande	knowledge	74.82		medium	`\| winogrande \| 0 \| acc \| 0.7482 \| _ \| 0.0122 \|`
AGIEval	reasoning	73.79	_sat_en	medium	`\| agieval_sat_en \| 0 \| acc \| 0.7379 \| _ \| 0.0307 \|`
BigBench	reasoning	72.38	_snarks	medium	`\| bigbench_snarks \| 0 \| multiple_choice_grade \| 0.7238 \| _ \| 0.0333 \|`
BigBench	reasoning	69.8	_reasoning_about_colored_objects	medium	`\| bigbench_reasoning_about_colored_objects \| 0 \| multiple_choice_grade \| 0.6980 \| _ \| 0.0103 \|`
BigBench	reasoning	68.76	_sports_understanding	medium	`\| bigbench_sports_understanding \| 0 \| multiple_choice_grade \| 0.6876 \| _ \| 0.0148 \|`
BigBench	reasoning	66.67	_date_understanding	medium	`\| bigbench_date_understanding \| 0 \| multiple_choice_grade \| 0.6667 \| _ \| 0.0246 \|`
HellaSwag	knowledge	65.2		medium	`\| hellaswag \| 0 \| acc \| 0.6520 \| _ \| 0.0048 \|`
AGIEval	reasoning	59.48	_lsat_rc	medium	`\| agieval_lsat_rc \| 0 \| acc \| 0.5948 \| _ \| 0.0300 \|`
ARC-Challenge	knowledge	58.62	_challenge	medium	`\| arc_challenge \| 0 \| acc \| 0.5862 \| _ \| 0.0144 \|`
BigBench	reasoning	56.84	_causal_judgement	medium	`\| bigbench_causal_judgement \| 0 \| multiple_choice_grade \| 0.5684 \| _ \| 0.0360 \|`
AGIEval	reasoning	51.37	_lsat_lr	medium	`\| agieval_lsat_lr \| 0 \| acc \| 0.5137 \| _ \| 0.0222 \|`
BigBench	reasoning	50.67	_logical_deduction_three_objects	medium	`\| bigbench_logical_deduction_three_objects \| 0 \| multiple_choice_grade \| 0.5067 \| _ \| 0.0289 \|`
BigBench	reasoning	50.67	_tracking_shuffled_objects_three_objects	medium	`\| bigbench_tracking_shuffled_objects_three_objects \| 0 \| multiple_choice_grade \| 0.5067 \| _ \| 0.0289 \|`
BigBench	reasoning	50.0	_navigate	medium	`\| bigbench_navigate \| 0 \| multiple_choice_grade \| 0.5000 \| _ \| 0.0158 \|`
AGIEval	reasoning	44.66	_sat_en_without_passage	medium	`\| agieval_sat_en_without_passage \| 0 \| acc \| 0.4466 \| _ \| 0.0347 \|`
BigBench	reasoning	43.6	_temporal_sequences	medium	`\| bigbench_temporal_sequences \| 0 \| multiple_choice_grade \| 0.4360 \| _ \| 0.0157 \|`
BigBench	reasoning	41.74	_ruin_names	medium	`\| bigbench_ruin_names \| 0 \| multiple_choice_grade \| 0.4174 \| _ \| 0.0233 \|`
BigBench	reasoning	41.4	_movie_recommendation	medium	`\| bigbench_movie_recommendation \| 0 \| multiple_choice_grade \| 0.4140 \| _ \| 0.0220 \|`
TruthfulQA	safety	39.41	_mc	medium	`\| truthfulqa_mc \| 1 \| mc1 \| 0.3941 \| _ \| 0.0171 \|`
AGIEval	reasoning	39.09	_sat_math	medium	`\| agieval_sat_math \| 0 \| acc \| 0.3909 \| _ \| 0.0330 \|`
AGIEval	reasoning	37.33	_logiqa_en	medium	`\| agieval_logiqa_en \| 0 \| acc \| 0.3733 \| _ \| 0.0190 \|`
BigBench	reasoning	35.66	_disambiguation_qa	medium	`\| bigbench_disambiguation_qa \| 0 \| multiple_choice_grade \| 0.3566 \| _ \| 0.0299 \|`
OpenBookQA	knowledge	34.4		medium	`\| openbookqa \| 0 \| acc \| 0.3440 \| _ \| 0.0213 \|`
BigBench	reasoning	29.8	_logical_deduction_five_objects	medium	`\| bigbench_logical_deduction_five_objects \| 0 \| multiple_choice_grade \| 0.2980 \| _ \| 0.0205 \|`
AGIEval	reasoning	25.59	_aqua_rat	medium	`\| agieval_aqua_rat \| 0 \| acc \| 0.2559 \| _ \| 0.0274 \|`
AGIEval	reasoning	25.22	_lsat_ar	medium	`\| agieval_lsat_ar \| 0 \| acc \| 0.2522 \| _ \| 0.0287 \|`
BigBench	reasoning	21.12	_tracking_shuffled_objects_five_objects	medium	`\| bigbench_tracking_shuffled_objects_five_objects \| 0 \| multiple_choice_grade \| 0.2112 \| _ \| 0.0115 \|`
BigBench	reasoning	20.71	_logical_deduction_seven_objects	medium	`\| bigbench_logical_deduction_seven_objects \| 0 \| multiple_choice_grade \| 0.2071 \| _ \| 0.0153 \|`
BigBench	reasoning	20.44	_salient_translation_error_detection	medium	`\| bigbench_salient_translation_error_detection \| 0 \| multiple_choice_grade \| 0.2044 \| _ \| 0.0128 \|`
BigBench	reasoning	20.06	_geometric_shapes	medium	`\| bigbench_geometric_shapes \| 0 \| multiple_choice_grade \| 0.2006 \| _ \| 0.0212 \|`
BigBench	reasoning	17.54	_tracking_shuffled_objects_seven_objects	medium	`\| bigbench_tracking_shuffled_objects_seven_objects \| 0 \| multiple_choice_grade \| 0.1754 \| _ \| 0.0091 \|`

Discussions (0)

none scraped.