orca_mini_v3_13B-GGUF

Home/Models/TheBloke/orca_mini_v3_13B-GGUF

TheBloke/orca_mini_v3_13B-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: text-generation
root model: psmathur/orca_mini_v3_13b
provider: TheBloke
license: other
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 356
likes: 4
created: —
last modified: 2023-09-27T12:47:37+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/orca_mini_v3_13B-GGUF
tags: transformersggufllamatext-generationendataset:psmathur/orca_mini_v1_datasetdataset:ehartford/dolphinarxiv:2306.02707base_model:pankajmathur/orca_mini_v3_13bbase_model:quantized:pankajmathur/orca_mini_v3_13blicense:otherregion:us

benchmark	category	score	context	conf	evidence
HellaSwag	knowledge	82.42	**	medium	`\| hellaswag \| acc_norm \| 0.8242 \| 0.0038 \|`
ARC-Challenge	knowledge	63.14	_challenge	medium	`\| arc_challenge \| acc_norm \| 0.6314 \| 0.0141 \|`
MMLU	knowledge	56.37	**	medium	`\| mmlu \| acc_norm \| 0.5637 \| 0.0351 \|`
TruthfulQA	safety	51.27	_mc	medium	`\| truthfulqa_mc \| mc2 \| 0.5127 \| 0.0157 \|`

none scraped.