SmolLM2-135M-Instruct-GGUF

Home/Models/Mungert/SmolLM2-135M-Instruct-GGUF

Mungert/SmolLM2-135M-Instruct-GGUF

kind: gguf
quant: gguf (16-bit)
family: smol
modality: text-generation
root model: HuggingFaceTB/SmolLM2-135M
provider: Mungert
license: apache-2.0
language: en
context: —
library: transformers
vRAM (GB): —
size on disk: —
downloads: 204
likes: 1
created: —
last modified: 2025-09-24T15:43:01+00:00 (2025)
huggingface: https://huggingface.co/Mungert/SmolLM2-135M-Instruct-GGUF
tags: transformersggufsafetensorsonnxtransformers.jstext-generationenarxiv:2502.02737base_model:HuggingFaceTB/SmolLM2-135Mbase_model:quantized:HuggingFaceTB/SmolLM2-135Mlicense:apache-2.0endpoints_compatibleregion:usconversational

benchmark	category	score	context	conf	evidence
PIQA	knowledge	68.4	PIQA	medium	`\| PIQA \| 68.4 \| 68.4 \|`
WinoGrande	knowledge	51.3	Winogrande	medium	`\| Winogrande \| 51.3 \| 51.3 \|`
HellaSwag	knowledge	42.1	HellaSwag	medium	`\| HellaSwag \| 42.1 \| 41.2 \|`
OpenBookQA	knowledge	34.6	OpenBookQA	medium	`\| OpenBookQA \| 34.6 \| 34.0 \|`
CommonsenseQA	knowledge	33.9	CommonsenseQA	medium	`\| CommonsenseQA \| 33.9 \| 32.7 \|`
MMLU	knowledge	31.5	MMLU (cloze)	medium	`\| MMLU (cloze) \| 31.5 \| 30.2 \|`
IFEval	instruction-following	29.9	IFEval (Average prompt/inst)	medium	`\| IFEval (Average prompt/inst) \| 29.9 \| 17.2 \|`
BBH	reasoning	28.2	BBH (3-shot)	medium	`\| BBH (3-shot) \| 28.2 \| 25.2 \|`
MT-Bench	chat	19.8	MT-Bench	medium	`\| MT-Bench \| 19.8 \| 16.8 \|`
TriviaQA	knowledge	4.1	TriviaQA	medium	`\| TriviaQA \| 4.1 \| 4.3 \|`
GSM8K	math	1.4	GSM8K (5-shot)	medium	`\| GSM8K (5-shot) \| 1.4 \| 1.0 \|`

none scraped.