orca_mini_v3_7B-GPTQ

Home/Models/TheBloke/orca_mini_v3_7B-GPTQ

TheBloke/orca_mini_v3_7B-GPTQ

kind: gptq
quant: gptq
family: misc
modality: text-generation
root model: psmathur/orca_mini_v3_7b
provider: TheBloke
license: other
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 69
likes: 11
created: —
last modified: 2023-09-27T12:45:35+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/orca_mini_v3_7B-GPTQ
tags: transformerssafetensorsllamatext-generationendataset:psmathur/orca_mini_v1_datasetdataset:ehartford/dolphinarxiv:2306.02707arxiv:2302.13971base_model:pankajmathur/orca_mini_v3_7bbase_model:quantized:pankajmathur/orca_mini_v3_7blicense:othertext-generation-inference4-bitgptqregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	79.66	**	medium	`\| hellaswag \| acc_norm \| 0.7966 \| 0.0043 \|`
ARC-Challenge	knowledge	57.17	_challenge	medium	`\| arc_challenge \| acc_norm \| 0.5717 \| 0.0145 \|`
MMLU	knowledge	52.34	**	medium	`\| mmlu \| acc_norm \| 0.5234 \| 0.035 \|`
TruthfulQA	safety	50.29	_mc	medium	`\| truthfulqa_mc \| mc2 \| 0.5029 \| 0.0156 \|`

none scraped.