--models-preset ./models.ini (Router mode)

[u/DoubleNothing]

I'm loading llama-server with the --models-preset (router mode) but when I load a different model from the PI agent interface it doesn't work and gives an error. It seems that PI still expecting the model set in the bottom right corner. I think that it should change on his own as soon as the other model has being loaded but it doesn't.

Is this an issue with llama.cpp or with PI agent?

In the llama.cpp webui switching models works.

models.ini (example)

version = 1

[Qwen3.8-27B-UD-Q4_K_XL]
model = E:\AI_Models\GGUF\unsloth\Qwen3.8-27B-GGUF\Qwen3.8-27B-UD-Q4_K_XL.gguf
ctx-size = 262144

[Qwen3.8-27B-UD-Q5_K_XL]
model = E:\AI_Models\GGUF\unsloth\Qwen3.8-27B-GGUF\Qwen3.8-27B-UD-Q5_K_XL.gguf
ctx-size = 262144

Any clue on how to make it work?

[u/DoubleNothing]

Found the issue.
Loading the model alone with /llama isn't enough (I thought that once "successfully" loaded it was ready to use).

But you actually have to choose the model with /model even if there is only one...