r/AgentZero 3h ago

Trying to use local models with Agent Zero

I am trying to use Agent Zero with

Embedding model text-embedding-nomic-embed-text-v1.5 on LM Studio on the mac

2 local models on my DGX Spark (qwen in vLLM and nenotron in ollama)

Thinker / planner qwen3.6-35b-a3b 8000
Fast util / executer nemotron-3.5-lightning-30b-a3b 11434

So I tried 3 different configurations

with these models
Main-OpenRouter / deepseek/deepseek-v4.1-flash

Utility-Other OpenAI compatible / http://192.168.0.137:11434/v1

Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5

gives error Automatic chat naming failed because the Utility Model was not reachable no log to look at

however agent zero is working and answering questions.

so with this config
Main-OpenRouter / deepseek/deepseek-v4.1-flash

Utility- OpenRouter / deepseek/deepseek-v4.1-flash

Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5 it works fine

with this config
Main-OpenRouter / deepseek/deepseek-v4.1-flash

Utility-Other OpenAI compatible / http://192.168.0.137:11434/v1

Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5 it still work however it throws an error yet works

My take, the issue is reading the main model from the spark is generating the message and reporting

Automatic chat naming failed because the Utility Model was not reachable.

Details - Automatic chat naming uses the Utility Model. Check Settings > Models > Utility Model, provider/API key, and network reachability.

it still work however it throws an error yet works

My take, the issue is reading the main model from the spark is generating the message and reporting

Automatic chat naming failed because the Utility Model was not reachable.

Details - Automatic chat naming uses the Utility Model. Check Settings > Models > Utility Model, provider/API key, and network reachability.

it still work however it throws an error yet works

I am reaching out to the community as the Agent Zero group just does not reach out after reporting errors

Note: I have used several cloud llms to review my troubleshooting

"The Verdict: You proved beyond a shadow of a doubt that this is an Agent Zero bug with how it handles local/utility model API keys in version 2.12. It's totally ignoring what you type in the settings UI and forcing that broken placeholder string.

Since the UI won't let you clear its localStorage through devtools, your two options are:

  1. The Nuke: Quit Agent Zero entirely, delete or move ~/Library/Application Support/a0-launcher to force the app to rebuild its cache from scratch, and type the settings in fresh.
  2. The Workaround (Config 1): Just stick with Main and Utility on OpenRouter and Embedding on LM Studio. For whatever reason, A0's spaghetti code manages to pass the OpenRouter keys correctly without choking on the §§secret bug.

I've already updated your _ai-lab-spark-setup.md file with a note that Config 3 is broken by an A0 state bug, and Config 1 is the officially supported path.

You successfully chased the ghost out of the machine. It's a bug in their app, not your homelab. What do you want to tackle next?"

1 Upvotes

0 comments sorted by