HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Qwen3.6-27B-MTP-GGUF

unsloth/Qwen3.6-27B-MTP-GGUF

kind
gguf
quant
gguf (16-bit)
family
qwen
modality
image-text-to-text
root model
Qwen/Qwen3.6-27B
provider
unsloth
license
apache-2.0
language
—
context
262,144
library
transformers
vRAM (GB)
—
size on disk
—
downloads
3,006,469
likes
1,188
created
—
last modified
2026-05-26T08:45:52+00:00 (2026)
huggingface
https://huggingface.co/unsloth/Qwen3.6-27B-MTP-GGUF
tags
transformersggufunslothqwenqwen3_5image-text-to-textbase_model:Qwen/Qwen3.6-27Bbase_model:quantized:Qwen/Qwen3.6-27Blicense:apache-2.0endpoints_compatibleregion:usimatrixconversational

Benchmark scores (0)

no scores extracted for this variant.

Discussions (45)

titleauthorstatuscommentstype
Qwen3.6 MTP can now run in Unsloth Studio!danielhanchenopen0disc
Is -np 1 / --parallel 1 still required for llama.cpp? I don't see it in examples for MTP any more...or am I missing something?vijaygillclosed0disc
UD-Q6_K_XL or Q8_0?XaviCampaopen0disc
DGX Spark --linear-backend flashinfer_b12x issuealgorithmcookiesclosed0disc
Question for @unsloth: mobile deployment?3morixdopen0disc
Qwen3.6 27B MTP with Visionzygoatopen0disc
Duplicate tensor name: blk.40.ssm_out.weight for BF16 filesjpetrinaclosed0disc
1000000 Context. How exactly?BigDeeperopen0disc
Qwen3.6-27B-MTP-UD-IQ4_XSabdo1948open0disc
mmproj support for MTPhitchhiker3010closed0disc
random chinese characters issue with unsloth GGUF for Qwen3.6-27B for the pre and post MTPMalmuk1closed0disc
Qwen3.6-27b-1M上下文需求。kelei999999closed0disc
Update README.mddyoungmerged0disc
IQ3XXS giving garbage outputmbhagyaclosed0disc
UD-Q4_K_XL produces 0% MTP draft acceptance — blk.64.attn_*/ffn_* quantized below the threshold for MTP rejection samplingreviseopen0disc
inference using vllmkuopchingopen0disc
Official llama.cpp slower than the https://github.com/am17an/llama.cpp.gitadr-inscopen0disc
Official llama.cpp now has '--spec-type draft-mtp'hellorkclosed0disc
the trade off is not good (new update)rosspanda0closed0disc
llama.cpp MTP crash with Unsloth sampler flagsMrWootzclosed0disc
ADD A WAY TO CHANGE THE CONTEXT length of a model in unsloth studio before loading pleasecurtis1969closed0disc
Report: 56 t/s on RTX 4090D (48GB VRAM) with UD-Q6_K_XLSlavikFopen0disc
Update README.mddyoungmerged0disc
Noticeable Performance DecreaseWebWeaverWraithclosed0disc
Starts with 50% speedup, but speed very fast decreasesseleznyovopen0disc
Number guessing inconsistencyEnigrandopen0disc
Are you going to release NVFP4 MTP GGUFsharon8811open0disc
One question about this GGUFalexloopsclosed0disc
Low VRAM<=8GB best result (40t/s WITHOUT MTP)hellorkopen0disc
FAST!!!! 39tps!mazuj2open0disc
Does the latest LM Studio not support it?nk789closed0disc
FYI : --spec-type mtp syntax has changed to --spec-type draft-mtpqenmeopen0disc
50% bump in speed.BrokeAmericanopen0disc
--n-gpu-layers or -nglowaoopen0disc
Does it support --spec-draft-device?dmicheopen0disc
This model is a bulldozerowaoopen0disc
is it work for gemma4?koyukiraclosed0disc
presence-penaltyowaoclosed0disc
no GGUF files found in repository unsloth/Qwen3.6-27B-GGUF-MTPmohamedemamclosed0disc
Stable MTP first release!danielhanchenclosed0disc
support openbmb/MiniCPM-V-4.6beyoruclosed0disc
Don't forget to add MLX too, please! ;-)egodoycaclosed0disc
These shoudl work on ik_llama.cpp tooubergarmclosed0disc
QWEN35_MTP requires nextn_predict_layers > 0.jidaigeistclosed0disc
No nextn_predict_layers?saldanhaclopen0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.