HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

notus-7B-v1-AWQ

TheBloke/notus-7B-v1-AWQ

kind
awq
quant
awq
family
misc
modality
text-generation
root model
argilla/notus-7b-v1
provider
TheBloke
license
mit
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
112
likes
3
created
—
last modified
2023-12-04T08:41:24+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/notus-7B-v1-AWQ
tags
transformerssafetensorsmistraltext-generationdporlaifpreferenceultrafeedbackconversationalendataset:argilla/ultrafeedback-binarized-preferencesbase_model:argilla/notus-7b-v1base_model:quantized:argilla/notus-7b-v1license:mitmodel-indextext-generation-inference4-bitawqregion:us

Benchmark scores (6)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge84.36low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |
WinoGrandeknowledge77.74low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |
MMLUknowledge61.07low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |
TruthfulQAsafety57.45low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |
GSM8Kmath12.74low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |
DROPreasoning9.66low| Zephyr 7B dDPO (HuggingFaceH4/zephyr-7b-beta) | 52.15 | 62.03 | 84.36 | 61.07 | **57.45** | 77.74 | 12.74 | **9.66** |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.