TheBloke/LUNA-SOLARkrautLM-Instruct-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| TruthfulQA | safety | 73.68 | _mc2 | medium | | truthfulqa_mc2 | Yaml | none | 0 | acc | 0.7368 | ± | 0.0149 | |
| GSM8K | math | 64.67 | medium | | gsm8k | Yaml | get-answer | 5 | exact_match | 0.6467 | ± | 0.0132 | | |
| MMLU | knowledge | 64.61 | medium | | mmlu | N/A | none | 0 | acc | 0.6461 | ± | 0.1215 | | |
| ARC-Challenge | knowledge | 25.0 | _challenge | medium | | arc_challenge | Yaml | none | 25 | acc | 0.692 | ± | 0.0135 | |
| HellaSwag | knowledge | 10.0 | medium | | hellaswag | Yaml | none | 10 | acc | 0.7131 | ± | 0.0045 | |
none scraped.