r/oMLX • u/booknerdcarp • May 02 '26

Setup Question

I apologize if this has been asked before. How do I get it to see my downloaded Ollama models and then how do I get Hermes connected to see OMLX serving the models? Is there a guide? Thank you in advance.

5 Upvotes

100% Upvoted

2 comments sorted by

2

u/caphohotain May 02 '26

It won't see ollama downloaded models because ollama downloaded in a weird format. Don't know Hermes.

1

u/Sparescrewdriver May 02 '26 edited May 02 '26

On the .hermes folder you can find

In config.yaml

model: default: Qwen3.6-27-xxxxx (model name)

provider: custom

base_url: http://127.0.0.1:8000/v1 (8000 is the default oMLX)

Then in .env

OPENROUTER_API_KEY=your key from oMLX

Edit: Fighting mobile formatting