HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen2-0.5B-Instruct

Qwen/Qwen2-0.5B-Instruct

kind
original
quant
bf16 (16-bit)
family
qwen
modality
text-generation
root model
Qwen/Qwen2-0.5B
provider
Qwen
license
apache-2.0
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
295,352
likes
201
created
—
last modified
2024-08-21T10:23:36+00:00 (2024)
huggingface
https://huggingface.co/Qwen/Qwen2-0.5B-Instruct
tags
transformerssafetensorsqwen2text-generationchatconversationalenbase_model:Qwen/Qwen2-0.5Bbase_model:finetune:Qwen/Qwen2-0.5Blicense:apache-2.0eval-resultstext-generation-inferenceendpoints_compatibledeploy:azureregion:usdeploy:sagemaker

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
C-Evalknowledge37.2C-Evalmedium| C-Eval | 37.2 | **45.2** | 55.3 | **63.8** |
MMLUknowledge35.0MMLUmedium| MMLU | 35.0 | **37.9** | 43.7 | **52.4** |
IFEvalinstruction-following14.6IFEval (Prompt Strict-Acc.)medium| IFEval (Prompt Strict-Acc.) | 14.6 | **20.0** | 16.8 | **29.0** |
GSM8Kmath11.3GSM8Kmedium| GSM8K | 11.3 | **40.1** | 35.3 | **61.6** |
HumanEvalcoding9.1HumanEvalmedium| HumanEval | 9.1 | **17.1** | 25.0 | **37.8** |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.