orca_mini_v3_13B-GPTQ

Home/Models/TheBloke/orca_mini_v3_13B-GPTQ

TheBloke/orca_mini_v3_13B-GPTQ

kind: gptq
quant: gptq
family: misc
modality: text-generation
root model: psmathur/orca_mini_v3_13b
provider: TheBloke
license: other
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 46
likes: 10
created: —
last modified: 2023-09-27T12:45:37+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/orca_mini_v3_13B-GPTQ
tags: transformerssafetensorsllamatext-generationendataset:psmathur/orca_mini_v1_datasetdataset:ehartford/dolphinarxiv:2306.02707base_model:pankajmathur/orca_mini_v3_13bbase_model:quantized:pankajmathur/orca_mini_v3_13blicense:othertext-generation-inference4-bitgptqregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	82.42	**	medium	`\| hellaswag \| acc_norm \| 0.8242 \| 0.0038 \|`
ARC-Challenge	knowledge	63.14	_challenge	medium	`\| arc_challenge \| acc_norm \| 0.6314 \| 0.0141 \|`
MMLU	knowledge	56.37	**	medium	`\| mmlu \| acc_norm \| 0.5637 \| 0.0351 \|`
TruthfulQA	safety	51.27	_mc	medium	`\| truthfulqa_mc \| mc2 \| 0.5127 \| 0.0157 \|`

none scraped.