PlatYi-34B-Llama-Q-v3-GGUF

Home/Models/TheBloke/PlatYi-34B-Llama-Q-v3-GGUF

TheBloke/PlatYi-34B-Llama-Q-v3-GGUF

kind: gguf
quant: gguf (2-bit)
family: llama
modality: text-generation
root model: kyujinpy/PlatYi-34B-Llama-Q-v3
provider: TheBloke
license: cc-by-nc-sa-4.0
language: en
context: 4096,
library: transformers
vRAM (GB): —
size on disk: —
downloads: 193
likes: 3
created: —
last modified: 2023-12-17T17:39:17+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/PlatYi-34B-Llama-Q-v3-GGUF
tags: transformersggufyitext-generationendataset:garage-bAInd/Open-Platypusbase_model:kyujinpy/PlatYi-34B-Llama-Q-v3base_model:quantized:kyujinpy/PlatYi-34B-Llama-Q-v3license:cc-by-nc-sa-4.0region:us

benchmark	category	score	conf	evidence
HellaSwag	knowledge	85.22	high	`\| PlatYi-34B-Llama-Q \| 71.13 \| 65.70 \| 85.22 \| 78.78 \| 53.64 \| 83.03 \| 60.42 \|`
WinoGrande	knowledge	83.03	high	`\| PlatYi-34B-Llama-Q \| 71.13 \| 65.70 \| 85.22 \| 78.78 \| 53.64 \| 83.03 \| 60.42 \|`
MMLU	knowledge	78.78	high	`\| PlatYi-34B-Llama-Q \| 71.13 \| 65.70 \| 85.22 \| 78.78 \| 53.64 \| 83.03 \| 60.42 \|`
GSM8K	math	60.42	high	`\| PlatYi-34B-Llama-Q \| 71.13 \| 65.70 \| 85.22 \| 78.78 \| 53.64 \| 83.03 \| 60.42 \|`
TruthfulQA	safety	53.64	high	`\| PlatYi-34B-Llama-Q \| 71.13 \| 65.70 \| 85.22 \| 78.78 \| 53.64 \| 83.03 \| 60.42 \|`

none scraped.