HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

med42-70B-GGUF

TheBloke/med42-70B-GGUF

kind
gguf
quant
gguf (2-bit)
family
misc
modality
text-generation
root model
m42-health/med42-70b
provider
TheBloke
license
other
language
en
context
4k
library
—
vRAM (GB)
—
size on disk
—
downloads
574
likes
25
created
—
last modified
2023-10-27T23:04:48+00:00 (2023)
huggingface
https://huggingface.co/TheBloke/med42-70B-GGUF
tags
transformersggufllamam42healthhealthcareclinical-llmtext-generationenbase_model:m42-health/med42-70bbase_model:quantized:m42-health/med42-70blicense:otherregion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge86.0MMLU Medical Geneticsmedium| MMLU Medical Genetics | 86.0 | 69.0 | 70.0 | 91.0 | 90.0 |
MMLUknowledge84.0MMLU College Biologymedium| MMLU College Biology | 84.0 | 79.2 | 72.2 | 95.1 | 94.4 |
MMLU-Proknowledge79.8MMLU Professional Medicinemedium| MMLU Professional Medicine | 79.8 | 71.3 | 70.2 | 93.0 | 95.2 |
MMLUknowledge74.3MMLU Clinical Knowledgemedium| MMLU Clinical Knowledge | 74.3 | 69.8 | 69.8 | 86.0 | 88.3 |
MMLUknowledge68.8MMLU College Medicinemedium| MMLU College Medicine | 68.8 | 67.0 | 61.3 | 76.9 | 80.9 |
MMLUknowledge67.4MMLU Anatomymedium| MMLU Anatomy | 67.4 | 62.2 | 56.3 | 80.0 | 77.8 |
MedQAdomain61.5MedQAmedium| MedQA | 61.5 | 53.4 | 50.8 | 78.9 | 79.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.