granite-7b-instruct-GGUF

Home/Models/Mungert/granite-7b-instruct-GGUF

Mungert/granite-7b-instruct-GGUF

kind: gguf
quant: gguf (16-bit)
family: misc
modality: text-generation
root model: ibm/granite-7b-base
provider: Mungert
license: apache-2.0
language: en
context: —
library: —
vRAM (GB): —
size on disk: —
downloads: 163
likes: 0
created: —
last modified: 2025-09-24T15:43:46+00:00 (2025)
huggingface: https://huggingface.co/Mungert/granite-7b-instruct-GGUF
tags: ggufgraniteibmlablabradorlabradoritetext-generationenarxiv:2403.01081base_model:ibm-granite/granite-7b-basebase_model:quantized:ibm-granite/granite-7b-baselicense:apache-2.0endpoints_compatibleregion:usconversational

benchmark	category	score	context	conf	evidence
MMLU	knowledge	54.58		low	`\| [Llama-2-13b-chat-hf](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) \| RLHF \| Llama-2-13b \| Human Annotators \| 6.65 \| 54.58 \|`
MT-Bench	chat	6.65		low	`\| [Llama-2-13b-chat-hf](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) \| RLHF \| Llama-2-13b \| Human Annotators \| 6.65 \| 54.58 \|`

none scraped.