openchat_3.5-16k-GGUF

Home/Models/TheBloke/openchat_3.5-16k-GGUF

TheBloke/openchat_3.5-16k-GGUF

kind: gguf
quant: gguf (2-bit)
family: misc
modality: —
root model: NurtureAI/openchat_3.5-16k
provider: TheBloke
license: apache-2.0
language: —
context: 16k
library: —
vRAM (GB): —
size on disk: —
downloads: 362
likes: 22
created: —
last modified: 2023-11-11T00:32:44+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/openchat_3.5-16k-GGUF
tags: transformersggufmistralarxiv:2309.11235arxiv:2303.08774arxiv:2212.10560license:apache-2.0region:us

benchmark	category	score	context	conf	evidence
GSM8K	math	77.3		low	`\| OpenChat 3.5 \| Apache-2.0 \| 7B \| 56.4 \| 64.3 \| 55.5 \| 28.6 \| 77.3 \|`
GSM8K	math	77.3	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
MMLU	knowledge	64.3		low	`\| OpenChat 3.5 \| Apache-2.0 \| 7B \| 56.4 \| 64.3 \| 55.5 \| 28.6 \| 77.3 \|`
MMLU	knowledge	64.3	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
TruthfulQA	safety	59.1	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
HumanEval	coding	55.5		low	`\| OpenChat 3.5 \| Apache-2.0 \| 7B \| 56.4 \| 64.3 \| 55.5 \| 28.6 \| 77.3 \|`
HumanEval	coding	55.5	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
BBH	reasoning	47.6	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
AGIEval	reasoning	47.4	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`
MATH	math	28.6		low	`\| OpenChat 3.5 \| Apache-2.0 \| 7B \| 56.4 \| 64.3 \| 55.5 \| 28.6 \| 77.3 \|`
MT-Bench	chat	7.81	BBH CoT	low	`\| OpenChat-3.5 \| 7B \| 61.6 \| 7.81 \| 47.4 \| 47.6 \| 59.1 \| 64.3 \| 55.5 \| 63.5 \| 77.3 \|`

none scraped.