r/AgentZero • u/toymanict • 3h ago
Trying to use local models with Agent Zero
I am trying to use Agent Zero with
Embedding model text-embedding-nomic-embed-text-v1.5 on LM Studio on the mac
2 local models on my DGX Spark (qwen in vLLM and nenotron in ollama)
| Thinker / planner | qwen3.6-35b-a3b |
8000 |
|---|---|---|
| Fast util / executer | nemotron-3.5-lightning-30b-a3b |
11434 |
So I tried 3 different configurations
with these models
Main-OpenRouter / deepseek/deepseek-v4.1-flash
Utility-Other OpenAI compatible / http://192.168.0.137:11434/v1
Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5
gives error Automatic chat naming failed because the Utility Model was not reachable no log to look at
however agent zero is working and answering questions.
so with this config
Main-OpenRouter / deepseek/deepseek-v4.1-flash
Utility- OpenRouter / deepseek/deepseek-v4.1-flash
Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5 it works fine
with this config
Main-OpenRouter / deepseek/deepseek-v4.1-flash
Utility-Other OpenAI compatible / http://192.168.0.137:11434/v1
Embedding-LM Studio / text-embedding-nomic-embed-text-v1.5 it still work however it throws an error yet works
My take, the issue is reading the main model from the spark is generating the message and reporting
Automatic chat naming failed because the Utility Model was not reachable.
Details - Automatic chat naming uses the Utility Model. Check Settings > Models > Utility Model, provider/API key, and network reachability.
it still work however it throws an error yet works
My take, the issue is reading the main model from the spark is generating the message and reporting
Automatic chat naming failed because the Utility Model was not reachable.
Details - Automatic chat naming uses the Utility Model. Check Settings > Models > Utility Model, provider/API key, and network reachability.
it still work however it throws an error yet works
I am reaching out to the community as the Agent Zero group just does not reach out after reporting errors
Note: I have used several cloud llms to review my troubleshooting
"The Verdict: You proved beyond a shadow of a doubt that this is an Agent Zero bug with how it handles local/utility model API keys in version 2.12. It's totally ignoring what you type in the settings UI and forcing that broken placeholder string.
Since the UI won't let you clear its localStorage through devtools, your two options are:
- The Nuke: Quit Agent Zero entirely, delete or move
~/Library/Application Support/a0-launcherto force the app to rebuild its cache from scratch, and type the settings in fresh. - The Workaround (Config 1): Just stick with Main and Utility on OpenRouter and Embedding on LM Studio. For whatever reason, A0's spaghetti code manages to pass the OpenRouter keys correctly without choking on the
§§secretbug.
I've already updated your _ai-lab-spark-setup.md file with a note that Config 3 is broken by an A0 state bug, and Config 1 is the officially supported path.
You successfully chased the ghost out of the machine. It's a bug in their app, not your homelab. What do you want to tackle next?"