Please upload - qwen3.8_27b_w4a8_convrot_qhead_mtp.safetensors

#4
by nafishasan60 - opened

Please upload - qwen3.8_27b_w4a8_convrot_qhead_mtp.safetensors

It is this model https://huggingface.co/Comfy-Org/Qwen3.8-27B/blob/main/text_encoders/qwen3.8_27b_w4a8.safetensors

I have been using it but this model doesn't seem to support mtp

Comfy Org org

It is this model https://huggingface.co/Comfy-Org/Qwen3.8-27B/blob/main/text_encoders/qwen3.8_27b_w4a8.safetensors

I have been using it but this model doesn't seem to support mtp

Double checked and it definitely has the mtp layers.

Kijai is correct. qwen3.8_27b_w4a8.safetensors has MTP support.

By the way, I didn't rely solely on qwen3.8_27b_w4a8.safetensors for this workflow. To generate the precise prompt structure, or rather, the required JSON file I used Llama.cpp running Qwen 3.6. This is actually my go-to local combination now, and I regularly use it to write text and craft highly structured scripts and prompts for video models like LTX 2.5 and MiniMax H3. Having this kind of local pipeline gives you unmatched flexibility. Best of all, I run this entire setup on a completely standard RTX 3060 12GB. And I can get around 50t/sec for Qwen 3.6 35B MoE quant.

Cheers!
LabMike3D
MTP

Sign up or log in to comment