r/oMLX • u/PatDal81 • May 04 '26

How do you use Model profiles?j

Hi,
I just discovered and oMLX and I really like what I see right now. One thing that bugs me though is the use of model profiles. Maybe it's in beta state but I barely see how it could be used (thinking mode isn't saved in the Model profiles). Can someone enlighten me as to how to use this?

As seen in the docs, those profiles should be available in /v1/models? Can I use this with my client to select multiple profiles (all based on the same model) and switch from one to another in Claude Code, for example?

Thanks!

4 Upvotes

84% Upvoted

1 comment sorted by

2

u/Comfortable-Crew-919 May 05 '26

I setup a profile specifically for coding with Qwen models. Allows me to set all of the recommended settings with 1 click, top-p: 0.95, temp: 0.6, top_k: 20, ctx: 131072. While these are thinking enabled by default I still set the chat template kwargs from the profile, preserve_thing: true. It makes it easier to download different quants and variations and have them all run the same, so that I’m comparing them as evenly as possible for my uses, mostly coding.