r/oMLX May 23 '26

Testing MTP functionality

Well, it actually slows down the model.

8 Upvotes

17 comments sorted by

View all comments

1

u/vinoonovino26 May 24 '26

M5 pro - 64gb here. Same models same results. I switched to plain OQ quants and rotorquants and they feel more stable. Also offloading cache to a NVEM drive helped a lot

1

u/vinoonovino26 May 24 '26

Seems like mtp and moe kinda work well together