DPOpenHermes-7B-v2-GGUF

Home/Models/TheBloke/DPOpenHermes-7B-v2-GGUF

DPOpenHermes-7B-v2-GGUF

TheBloke/DPOpenHermes-7B-v2-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: text-generation
root model: openaccess-ai-collective/DPOpenHermes-7B-v2
provider: TheBloke
license: apache-2.0
language: en
context: 32768,
library: transformers
vRAM (GB): —
size on disk: —
downloads: 285
likes: 8
created: —
last modified: 2023-12-07T10:20:28+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/DPOpenHermes-7B-v2-GGUF
tags: transformersggufmistraltext-generationendataset:teknium/openhermesdataset:allenai/ultrafeedback_binarized_cleaneddataset:Intel/orca_dpo_pairsbase_model:openaccess-ai-collective/DPOpenHermes-7B-v2base_model:quantized:openaccess-ai-collective/DPOpenHermes-7B-v2license:apache-2.0region:usconversational

Benchmark scores (27)

benchmark	category	score	context	conf	evidence
AGIEval	reasoning	74.27	_sat_en	medium	`\| agieval_sat_en \| 0 \| acc \| 0.7427 \| _ \| 0.0305 \|`
BigBench	reasoning	70.17	_snarks	medium	`\| bigbench_snarks \| 0 \| multiple_choice_grade \| 0.7017 \| _ \| 0.0341 \|`
BigBench	reasoning	68.15	_sports_understanding	medium	`\| bigbench_sports_understanding \| 0 \| multiple_choice_grade \| 0.6815 \| _ \| 0.0148 \|`
BigBench	reasoning	67.25	_reasoning_about_colored_objects	medium	`\| bigbench_reasoning_about_colored_objects \| 0 \| multiple_choice_grade \| 0.6725 \| _ \| 0.0105 \|`
BigBench	reasoning	65.31	_date_understanding	medium	`\| bigbench_date_understanding \| 0 \| multiple_choice_grade \| 0.6531 \| _ \| 0.0248 \|`
ARC-Challenge	knowledge	62.71	_challenge	medium	`\| arc_challenge \| 0 \| acc \| 0.6271 \| _ \| 0.0141 \|`
AGIEval	reasoning	61.34	_lsat_rc	medium	`\| agieval_lsat_rc \| 0 \| acc \| 0.6134 \| _ \| 0.0297 \|`
BigBench	reasoning	56.32	_causal_judgement	medium	`\| bigbench_causal_judgement \| 0 \| multiple_choice_grade \| 0.5632 \| _ \| 0.0361 \|`
AGIEval	reasoning	53.33	_lsat_lr	medium	`\| agieval_lsat_lr \| 0 \| acc \| 0.5333 \| _ \| 0.0221 \|`
BigBench	reasoning	50.0	_navigate	medium	`\| bigbench_navigate \| 0 \| multiple_choice_grade \| 0.5000 \| _ \| 0.0158 \|`
BigBench	reasoning	47.67	_logical_deduction_three_objects	medium	`\| bigbench_logical_deduction_three_objects \| 0 \| multiple_choice_grade \| 0.4767 \| _ \| 0.0289 \|`
BigBench	reasoning	47.67	_tracking_shuffled_objects_three_objects	medium	`\| bigbench_tracking_shuffled_objects_three_objects \| 0 \| multiple_choice_grade \| 0.4767 \| _ \| 0.0289 \|`
AGIEval	reasoning	47.09	_sat_en_without_passage	medium	`\| agieval_sat_en_without_passage \| 0 \| acc \| 0.4709 \| _ \| 0.0349 \|`
BigBench	reasoning	43.75	_ruin_names	medium	`\| bigbench_ruin_names \| 0 \| multiple_choice_grade \| 0.4375 \| _ \| 0.0235 \|`
AGIEval	reasoning	40.45	_sat_math	medium	`\| agieval_sat_math \| 0 \| acc \| 0.4045 \| _ \| 0.0332 \|`
BigBench	reasoning	38.8	_movie_recommendation	medium	`\| bigbench_movie_recommendation \| 0 \| multiple_choice_grade \| 0.3880 \| _ \| 0.0218 \|`
AGIEval	reasoning	37.63	_logiqa_en	medium	`\| agieval_logiqa_en \| 0 \| acc \| 0.3763 \| _ \| 0.0190 \|`
BigBench	reasoning	34.11	_disambiguation_qa	medium	`\| bigbench_disambiguation_qa \| 0 \| multiple_choice_grade \| 0.3411 \| _ \| 0.0296 \|`
BigBench	reasoning	33.37	_salient_translation_error_detection	medium	`\| bigbench_salient_translation_error_detection \| 0 \| multiple_choice_grade \| 0.3337 \| _ \| 0.0149 \|`
BigBench	reasoning	31.8	_temporal_sequences	medium	`\| bigbench_temporal_sequences \| 0 \| multiple_choice_grade \| 0.3180 \| _ \| 0.0147 \|`
BigBench	reasoning	30.0	_logical_deduction_five_objects	medium	`\| bigbench_logical_deduction_five_objects \| 0 \| multiple_choice_grade \| 0.3000 \| _ \| 0.0205 \|`
AGIEval	reasoning	27.39	_lsat_ar	medium	`\| agieval_lsat_ar \| 0 \| acc \| 0.2739 \| _ \| 0.0295 \|`
BigBench	reasoning	21.2	_tracking_shuffled_objects_five_objects	medium	`\| bigbench_tracking_shuffled_objects_five_objects \| 0 \| multiple_choice_grade \| 0.2120 \| _ \| 0.0116 \|`
BigBench	reasoning	20.89	_geometric_shapes	medium	`\| bigbench_geometric_shapes \| 0 \| multiple_choice_grade \| 0.2089 \| _ \| 0.0215 \|`
BigBench	reasoning	20.57	_logical_deduction_seven_objects	medium	`\| bigbench_logical_deduction_seven_objects \| 0 \| multiple_choice_grade \| 0.2057 \| _ \| 0.0153 \|`
AGIEval	reasoning	19.29	_aqua_rat	medium	`\| agieval_aqua_rat \| 0 \| acc \| 0.1929 \| _ \| 0.0248 \|`
BigBench	reasoning	17.2	_tracking_shuffled_objects_seven_objects	medium	`\| bigbench_tracking_shuffled_objects_seven_objects \| 0 \| multiple_choice_grade \| 0.1720 \| _ \| 0.0090 \|`

Discussions (0)

none scraped.