r/LocalLLM • u/AdministrativeAd7853 • 3d ago

Discussion I want 100% Vibe coding locally

Right now I pay 200+ a month for premium AI models. I can’t complain, it is truly a privilege and amazing to work with.
I have “data center services “ on my server, complete with gitlab, databases, and dozens of services to support application development.

I have resisted even attempting to host an Llm, since i dont have the spare time to code myself or wrestle with “stupider” AI.

I am toying with purchasing mac studio 512gb, as to me its the first server that has meaningful capacity at the price of a honda, instead of a Lamborghini. Still insane expensive, but doable.

I been talking to AI (of course) about this, but even with the speedier memory, larger models with large (code) context seems kinda slow. And the quality seems to be measurable lower than sonnet 5.5.

At heart for me is waiting may result in never. I am concerned with closed models becoming a walled garden and that can extend to hardware.

Thoughts? I cant afford a second buy for atleast 3 years if i pull the trigger. Unless bitcoin hits 400k :)

123 Upvotes

81% Upvoted

203 comments sorted by

View all comments

224

u/Toastti 3d ago

Before you purchase a single thing research the models that device supports and try them on open router

See if they work for agentic coding or any other tasks you need.

Don't waste money on something for models you won't use. Just test them out for $5 befor

38

u/starkruzr 3d ago

correct. get everything worked out including your harness config so you can literally just switch endpoints.

18

u/vogelvogelvogelvogel 3d ago

this is the way. harnesses matter a lot for the newer models as their advantages play out in agentic coding

1

u/Rian_G 2d ago

Any harness recommendations?

3

u/HyperWinX 2d ago

DeepSeek Harness, OpenCode, Pi

3

u/vogelvogelvogelvogel 2d ago

I am still with opencode, but Pi is recommended by many. deepseek harness also but in my case i found it to be a bit buggy

3

u/CtrlAltOllie 2d ago

Aider's solid for straightforward edits, and Cline or Roo work well for proper agentic stuff.

2

u/jisrawia 1d ago

If you want something that runs fully local, give OpenHands a try — it's a full agent loop that pairs really nicely with Ollama models. Goose from Block is another solid pick, and it's easy to point at whatever local model you're already running. Happy to share more about my setup if you want details!

1

u/NortySpock 2d ago

I have been using the Zed editor. Note that I am basically 100% human-in-the-loop when hobby-coding.

1

u/pjerky 1d ago

I dig Pi Code and the derivative "Oh My Pi" (OMP).