meditron-70B-GPTQ

Home/Models/TheBloke/meditron-70B-GPTQ

TheBloke/meditron-70B-GPTQ

kind: gptq
quant: gptq
family: misc
modality: text-generation
root model: epfl-llm/meditron-70b
provider: TheBloke
license: llama2
language: en
context: 4K
library: —
vRAM (GB): —
size on disk: —
downloads: 548
likes: 5
created: —
last modified: 2023-11-30T21:24:40+00:00 (2023)
huggingface: https://huggingface.co/TheBloke/meditron-70B-GPTQ
tags: transformerssafetensorsllamatext-generationmedicalhealthllama2endataset:bigbio/med_qadataset:medmcqadataset:bigbio/pubmed_qadataset:epfl-llm/guidelinesarxiv:2311.16079base_model:epfl-llm/meditron-70bbase_model:quantized:epfl-llm/meditron-70blicense:llama2text-generation-inference4-bitgptqregion:us

benchmark	category	score	context	conf	evidence
MMLU	knowledge	77.6	MMLU-Medical	medium	`\| MMLU-Medical \| 77.6 \| 77.9 \| 74.5 \| 65.7 \|`
MedQA	domain	70.2	MedQA-4-Option	medium	`\| MedQA-4-Option \| 70.2 \| 63.8 \| 63.9 \| 56.8 \|`
MedQA	domain	64.4	MedQA	medium	`\| MedQA \| 64.4 \| 61.5 \| 59.1 \| 50.8 \|`

none scraped.