smol-7B-GGUF

Home/Models/TheBloke/smol-7B-GGUF

TheBloke/smol-7B-GGUF

kind: gguf
quant: gguf (2-bit)
family: smol
modality: text-generation
root model: rishiraj/smol-7b
provider: TheBloke
license: apache-2.0
language: en
context: 8192,
library: —
vRAM (GB): —
size on disk: —
downloads: 167
likes: 10
created: —
last modified: 2023-12-10T11:36:03+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/smol-7B-GGUF
tags: transformersggufmistralgenerated_from_trainertext-generationendataset:HuggingFaceH4/no_robotsbase_model:rishiraj/smol-7bbase_model:quantized:rishiraj/smol-7blicense:apache-2.0region:usconversational

benchmark	category	score	conf	evidence
HellaSwag	knowledge	84.77	low	`\| rishiraj/smol-7b \| 67.11 \| 63.74 \| 84.77 \| 65 \| 46.17 \| 80.66 \| 62.32 \|`
WinoGrande	knowledge	80.66	low	`\| rishiraj/smol-7b \| 67.11 \| 63.74 \| 84.77 \| 65 \| 46.17 \| 80.66 \| 62.32 \|`
MMLU	knowledge	65.0	low	`\| rishiraj/smol-7b \| 67.11 \| 63.74 \| 84.77 \| 65 \| 46.17 \| 80.66 \| 62.32 \|`
GSM8K	math	62.32	low	`\| rishiraj/smol-7b \| 67.11 \| 63.74 \| 84.77 \| 65 \| 46.17 \| 80.66 \| 62.32 \|`
TruthfulQA	safety	46.17	low	`\| rishiraj/smol-7b \| 67.11 \| 63.74 \| 84.77 \| 65 \| 46.17 \| 80.66 \| 62.32 \|`

none scraped.