HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3.6-27B-FP8

Qwen/Qwen3.6-27B-FP8

kind
fp8
quant
fp8 (8-bit)
family
qwen
modality
image-text-to-text
root model
Qwen/Qwen3.6-27B
provider
Qwen
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
7,072,045
likes
327
created
—
last modified
2026-04-24T02:39:18+00:00 (2026)
huggingface
https://huggingface.co/Qwen/Qwen3.6-27B-FP8
tags
transformerssafetensorsqwen3_5image-text-to-textconversationalbase_model:Qwen/Qwen3.6-27Bbase_model:quantized:Qwen/Qwen3.6-27Blicense:apache-2.0endpoints_compatiblefp8deploy:azureregion:us

Benchmark scores (1)

benchmarkcategoryscorecontextconfevidence
Terminal-Benchagentic-coding2.0mediumTerminal-Bench 2.0

Discussions (16)

titleauthorstatuscommentstype
Listed on OpenModelMapduola15open0disc
Update README.mdDev8ngopen0disc
Update README.mdDev8ngopen0disc
qwen3.6dagezhclosed0disc
Any hope for a dynamic version of this model?mirixopen0disc
Performance report on RTX 4090D (48GB VRAM): 40 t/sSlavikFopen0disc
Cannot run on RTX PRO 6000 Blackwell + WSL2 — Mamba state cache OOMnoMugopopen0disc
The response from SGLang 0.5.10.post1 is garbled.zhazhahui080507open0disc
Garbage outputandyleleclosed0disc
Just want to say thank youThyranniusclosed0disc
SGLang --speculative-algorithm NEXTN or EAGLE?pathosethoslogosopen0disc
VLLM warning about Using uncalibrated q_scale 1.0 and/or prob_scale 1.0 with fp8 attentionandroiddrewopen0disc
NVFP4celikburakopen0disc
Parameter model.layers.15.mlp.gate_gate_up_proj.weight_scale_inv not found in params_dictCHNtentesopen0disc
[Question] Can the model be run on Nvidia DGX Spark?hubertshelleyopen0disc
About this FP8sudo-0x2aclosed0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.