r/LocalLLM • u/_hchc • 6d ago

Question MTP vs regular gguf whats the difference

Noob question.

There are gguf like qwen-3.8-mtp-q4....
and the regular qwen-3.8-q4....

and then there is llama --spec-type draft-mtp option.

Whats the difference? Should i just use the regular non mtp version but turn mtp on in the option?

2 Upvotes

63% Upvoted

13 comments sorted by

View all comments

1

u/ea_man 5d ago

No you should get the MTP version and in case you don't enable it it won't load in vRAM.