TheBloke/openchat-3.5-1210-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| GSM8K | math | 77.3 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| GSM8K | math | 77.3 | low | | OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** | | |
| HumanEval | coding | 68.9 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| MMLU | knowledge | 65.3 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| MMLU | knowledge | 65.3 | low | | OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** | | |
| HumanEval | coding | 64.6 | low | | ChatGPT (December 12, 2023) | - | 64.6 | | |
| TruthfulQA | safety | 61.8 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| BBH | reasoning | 49.5 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| AGIEval | reasoning | 48.0 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
| MATH | math | 28.9 | low | | OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** | | |
| MT-Bench | chat | 7.76 | BBH CoT | high | | OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 | |
none scraped.