HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3.6-27B-NVFP4

unsloth/Qwen3.6-27B-NVFP4

kind
nvfp4
quant
nvfp4 (4-bit)
family
qwen
modality
image-text-to-text
root model
Qwen/Qwen3.6-27B
provider
unsloth
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
2,668,382
likes
255
created
—
last modified
2026-07-12T13:49:13+00:00 (2026)
huggingface
https://huggingface.co/unsloth/Qwen3.6-27B-NVFP4
tags
transformerssafetensorsqwen3_5image-text-to-textunslothqwenconversationalbase_model:Qwen/Qwen3.6-27Bbase_model:quantized:Qwen/Qwen3.6-27Blicense:apache-2.0endpoints_compatiblecompressed-tensorsdeploy:azureregion:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
QuALITYknowledge100.0mediumquality=100
AIME 2025math93.12low| Unsloth NVFP4 | 86.25 | 86.34 | 93.12 |
GPQAreasoning86.34low| Unsloth NVFP4 | 86.25 | 86.34 | 93.12 |
MMLU-Proknowledge86.25low| Unsloth NVFP4 | 86.25 | 86.34 | 93.12 |
Terminal-Benchagentic-coding2.0mediumTerminal-Bench 2.0

Discussions (15)

titleauthorstatuscommentstype
DGX Spark Instructions!danielhanchenopen0disc
New NVFP4 Update: More accurate, smaller and faster!danielhanchenopen0disc
Garbage with --kv-cache-dtype bfloat16ikirshopen0disc
Running on a 5090wrmthorneopen0disc
Are we getting the gguf version of this?playerxyzopen0disc
3090 Questionmtclopen0disc
ValueError: --linear-backend=flashinfer_b12x was requested but no 'flashinfer_b12x' kernel exists for this layer typeregmibijayopen0disc
NVFP4 vs FP8 throughput on an RTX 6000 Pro 96 GB (Blackwell) - real vLLM numbersjanreges3open0disc
Config.json says nvfp4, but model.tensors says F8_E4M3that80-20open0disc
Anyone experienced degraded image multimodal result?azidanitopen0disc
Tool allucinations in RTX PRO 6000kartojalopen0disc
MTP added in!danielhanchenopen0disc
MTP?tyapoopen0disc
Impossible to run in a 5090 with any context window, no even 8192.hdnh2006open0disc
Why is it too big?alexcardoopen0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.