HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3-4B-Instruct-2507

unsloth/Qwen3-4B-Instruct-2507

kind
original
quant
bf16 (16-bit)
family
qwen
modality
text-generation
root model
Qwen/Qwen3-4B-Instruct-2507
provider
unsloth
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
38,537
likes
26
created
—
last modified
2025-08-06T21:35:26+00:00 (2025)
huggingface
https://huggingface.co/unsloth/Qwen3-4B-Instruct-2507
tags
transformerssafetensorsqwen3text-generationunslothconversationalarxiv:2505.09388base_model:Qwen/Qwen3-4B-Instruct-2507base_model:finetune:Qwen/Qwen3-4B-Instruct-2507license:apache-2.0text-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (9)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge80.2MMLU-Reduxmedium| MMLU-Redux | 80.2 | 84.1 | 77.3 | **84.2** |
IFEvalinstruction-following74.5IFEvalmedium| IFEval | 74.5 | **83.7** | 81.2 | 83.4 |
MMLU-Proknowledge62.8MMLU-Promedium| MMLU-Pro | 62.8 | 69.1 | 58.0 | **69.6** |
MMLU-Proknowledge56.2MMLU-ProXmedium| MMLU-ProX | 56.2 | **65.1** | 49.6 | 61.6 |
BFCL (function calling)agentic53.0BFCL-v3medium| BFCL-v3 | 53.0 | 58.6 | 57.6 | **61.9** |
GPQAreasoning50.3GPQAmedium| GPQA | 50.3 | 54.8 | 41.7 | **62.0** |
LiveCodeBenchcoding31.5LiveCodeBench v6 (25.02-25.05)medium| LiveCodeBench v6 (25.02-25.05) | 31.5 | 29.0 | 26.4 | **35.1** |
AIME 2025math22.7AIME25medium| AIME25 | 22.7 | 21.6 | 19.1 | **47.4** |
Chatbot Arenachat15.9Arena-Hard v2*medium| Arena-Hard v2* | 15.9 | 24.8 | 9.5 | **43.4** |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.