TheBloke/juanako-7B-v1-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| BoolQ | knowledge | 83.55 | medium | | boolq | Yaml | none | acc | 0.8355 | ± | 0.0065 | | |
| PIQA | knowledge | 81.94 | medium | | piqa | Yaml | none | acc | 0.8194 | ± | 0.0090 | | |
| WinoGrande | knowledge | 76.09 | medium | | winogrande | Yaml | none | acc | 0.7609 | ± | 0.0120 | | |
| HellaSwag | knowledge | 65.54 | medium | | hellaswag | Yaml | none | acc | 0.6554 | ± | 0.0047 | | |
| MMLU | knowledge | 60.85 | medium | | mmlu | N/A | none | acc | 0.6085 | ± | 0.1321 | | |
| TruthfulQA | safety | 58.47 | - _mc2 | medium | | - truthfulqa_mc2 | Yaml | none | acc | 0.5847 | ± | 0.0153 | |
| ARC-Challenge | knowledge | 56.91 | _challenge | medium | | arc_challenge | Yaml | none | acc | 0.5691 | ± | 0.0145 | |
| GSM8K | math | 45.56 | medium | | gsm8k | Yaml | get-answer | exact_match | 0.4556 | ± | 0.0137 | | |
| TruthfulQA | safety | 41.98 | - _mc1 | medium | | - truthfulqa_mc1 | Yaml | none | acc | 0.4198 | ± | 0.0173 | |
| TruthfulQA | safety | 26.08 | medium | | truthfulqa | N/A | none | bleu_max | 26.0803 | ± | 0.6528 | |
none scraped.