Kunoichi-7B-AWQ

Home/Models/TheBloke/Kunoichi-7B-AWQ

TheBloke/Kunoichi-7B-AWQ

kind: awq
quant: awq
family: misc
modality: text-generation
root model: SanjiWatsuki/Kunoichi-7B
provider: TheBloke
license: cc-by-nc-4.0
language: —
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 1,519
likes: 8
created: —
last modified: 2024-01-05T14:36:28+00:00 (2024)
huggingface: https://huggingface.co/TheBloke/Kunoichi-7B-AWQ
tags: transformerssafetensorsmistraltext-generationmergebase_model:SanjiWatsuki/Kunoichi-7Bbase_model:quantized:SanjiWatsuki/Kunoichi-7Blicense:cc-by-nc-4.0text-generation-inference4-bitawqregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	86.4		low	`\| GPT-4 \| 8.99 \| 62.52 \| 86.4 \| 0.86 \|`
MT-Bench	chat	9.32		low	`\| GPT-4-Turbo \| 9.32 \| - \| - \| - \|`

none scraped.