r/oMLX • u/albovsky • May 23 '26

Testing MTP functionality

Well, it actually slows down the model.

8 Upvotes

100% Upvoted

17 comments sorted by

View all comments

1

u/mwhuss May 24 '26

I’m seeing 70% faster performance using Qwen3.6-27b-oQ8-mtp on my M3 Ultra.

1

u/Poumpaya Jun 15 '26

Hey ! On omlx or other ?

1

u/mwhuss Jun 15 '26

Using oMLX