HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3-4B-Thinking-2507-FP8

unsloth/Qwen3-4B-Thinking-2507-FP8

kind
fp8
quant
fp8 (8-bit)
family
qwen
modality
text-generation
root model
Qwen/Qwen3-4B-Thinking-2507-FP8
provider
unsloth
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
178
likes
2
created
—
last modified
2025-11-20T14:44:51+00:00 (2025)
huggingface
https://huggingface.co/unsloth/Qwen3-4B-Thinking-2507-FP8
tags
transformerssafetensorsqwen3text-generationunslothconversationalarxiv:2505.09388base_model:Qwen/Qwen3-4B-Thinking-2507-FP8base_model:quantized:Qwen/Qwen3-4B-Thinking-2507-FP8license:apache-2.0text-generation-inferenceendpoints_compatiblefp8region:us

Benchmark scores (9)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge89.5MMLU-Reduxmedium| MMLU-Redux | **89.5** | 83.7 | 86.1 |
IFEvalinstruction-following86.5IFEvalmedium| IFEval | 86.5 | 81.9 | **87.4** |
MMLU-Proknowledge78.5MMLU-Promedium| MMLU-Pro | **78.5** | 70.4 | 74.0 |
MMLU-Proknowledge73.1MMLU-ProXmedium| MMLU-ProX | **73.1** | 61.0 | 64.2 |
AIME 2025math70.9AIME25medium| AIME25 | 70.9 | 65.6 | **81.3** |
BFCL (function calling)agentic69.1BFCL-v3medium| BFCL-v3 | 69.1 | 65.9 | **71.2** |
GPQAreasoning65.8GPQAmedium| GPQA | **65.8** | 55.9 | **65.8** |
LiveCodeBenchcoding57.4LiveCodeBench v6 (25.02-25.05)medium| LiveCodeBench v6 (25.02-25.05) | **57.4** | 48.4 | 55.2 |
Chatbot Arenachat36.3Arena-Hard v2$medium| Arena-Hard v2$ | **36.3** | 13.7 | 34.9 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.