HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

openchat-3.5-1210-GGUF

TheBloke/openchat-3.5-1210-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
openchat/openchat-3.5-1210
provider
TheBloke
license
apache-2.0
language
—
context
8192,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
3,169
likes
51
created
—
last modified
2023-12-15T16:08:45+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/openchat-3.5-1210-GGUF
tags
transformersggufmistralopenchatC-RLFTtext-generationdataset:openchat/openchat_sharegpt4_datasetdataset:kaist-ai/Feedback-Collectiondataset:imone/OpenOrca_FLANdataset:LDJnr/LessWrong-Amplify-Instructdataset:LDJnr/Pure-Dovedataset:LDJnr/Verified-Cameldataset:tiedong/goatdataset:glaiveai/glaive-code-assistantdataset:meta-math/MetaMathQAdataset:OpenAssistant/oasst_top1_2023-08-25dataset:TIGER-Lab/MathInstructarxiv:2309.11235arxiv:2303.08774arxiv:2212.10560base_model:openchat/openchat-3.5-1210base_model:quantized:openchat/openchat-3.5-1210license:apache-2.0region:us

Benchmark scores (11)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath77.3BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
GSM8Kmath77.3low| OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** |
HumanEvalcoding68.9BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
MMLUknowledge65.3BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
MMLUknowledge65.3low| OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** |
HumanEvalcoding64.6low| ChatGPT (December 12, 2023) | - | 64.6 |
TruthfulQAsafety61.8BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
BBHreasoning49.5BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
AGIEvalreasoning48.0BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |
MATHmath28.9low| OpenChat 3.5 1210 | Apache-2.0 | **7B** | **60.1** | 65.3 | **68.9** | **28.9** | **77.3** |
MT-Benchchat7.76BBH CoThigh| OpenChat-3.5-1210 | **7B** | **63.8** | 7.76 | **68.9** | **49.5** | **48.0** | **61.8** | 65.3 | **77.3** | 61.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.