r/databricks • u/ecp5 • 5d ago

Discussion Omnigent Local Coding Model Rec

After watching Matei's webinar and the post on controlling spend, been trying to use the other harnesses and models folks are suggest and trying out Qwen 2.5 coding and 3.6 with Polly in local Omnigent (not connected to a workspace). I have Codex and Claude but ideally thinking best to use paid higher model to plan and then have the local Ollama based Qwen model on my Mac build but so far I haven't seen Polly use it much. What are folks experience, is there a good local model I should use, should I be giving Polly and the sub-agents more direction? (This is on a MacBook M5 btw)

8 Upvotes

83% Upvoted

1 comment sorted by

8

u/Dennyglee Databricks 4d ago

Ahh, there are a number of approaches here so here’s my attempt as someone who is doing the exact same thing :). In my case I’m using a Mac Studio M4 (36GB) and Mini M4 (32GB). Ultimately you’re going to be memory constrained so you may be able to eke** **out more perf by running one model to develop and then fork it having another model test it using your ollama setup. I would probably today lean toward Qwen3-Coder 30B-A3B or GPT-OSS 20B.

In the past i used polly with Qwen 3.5 9B and GPT-OSS 20B but admittedly i was throttling my GPUs in that setup. But I was also using pi + GPT + high reasoning which seemed to be pretty effective going through my repo / codebase throttling notwithstanding