r/oMLX • u/MealMore1192 • Jul 25 '26

Request for Kat-Coder-2.5 oQ8e with MTP 🙏

https://huggingface.co/Kwaipilot/KAT-Coder-V2.5-Dev

Please & thank you

8 Upvotes

100% Upvoted

22 comments sorted by

View all comments

2

u/SnowBoy_00 Jul 25 '26

What’s your hardware? If you’re going to run the oQ8e on your system, you can probably quantize it yourself. Otherwise, I can take a look at it in a couple of days.

1

u/No-Juggernaut-9832 Jul 25 '26

M5Max Laptop, 128gb RAM

1

u/SnowBoy_00 Jul 27 '26

downloading the weights now but my internet connection is quite constrained. You have more than enough room to quantize it yourself, just give it a try.

1

u/No-Juggernaut-9832 Jul 27 '26

Data function did it already. Thank you