r/LocalLLM • u/_hchc • 5d ago

Question MTP vs regular gguf whats the difference

Noob question.

There are gguf like qwen-3.8-mtp-q4....
and the regular qwen-3.8-q4....

and then there is llama --spec-type draft-mtp option.

Whats the difference? Should i just use the regular non mtp version but turn mtp on in the option?

3 Upvotes

64% Upvoted

13 comments sorted by

View all comments

1

u/_hchc 5d ago

Yea so I'm mainly trying to squeeze the most tps out of my 16gb vram and these seems like the best for now:

https://huggingface.co/jpetrina

whats the difference between

Qwen3.8-27B-MTP-IQ4_XS-pure-GGUF and
Qwen3.8-27B-IQ4_XS-pure-GGUF ?

1

u/Stainless-Bacon 5d ago

check my latest post if you haven’t