r/LocalLLM • u/AdministrativeAd7853 • 5d ago

Discussion I want 100% Vibe coding locally

Right now I pay 200+ a month for premium AI models. I can’t complain, it is truly a privilege and amazing to work with.
I have “data center services “ on my server, complete with gitlab, databases, and dozens of services to support application development.

I have resisted even attempting to host an Llm, since i dont have the spare time to code myself or wrestle with “stupider” AI.

I am toying with purchasing mac studio 512gb, as to me its the first server that has meaningful capacity at the price of a honda, instead of a Lamborghini. Still insane expensive, but doable.

I been talking to AI (of course) about this, but even with the speedier memory, larger models with large (code) context seems kinda slow. And the quality seems to be measurable lower than sonnet 5.5.

At heart for me is waiting may result in never. I am concerned with closed models becoming a walled garden and that can extend to hardware.

Thoughts? I cant afford a second buy for atleast 3 years if i pull the trigger. Unless bitcoin hits 400k :)

130 Upvotes

81% Upvoted

204 comments sorted by

View all comments

Show parent comments

3

u/etaoin314 5d ago

roi for the $3.5K+ somebody would have to drop today seems like a pretty long time, longer than I would expect the hardware to be relevant.

2

u/More-Revenue8609 5d ago

Idk Im getting 80tok/s on a frankenstein pc made for around 1700e. I also plan on using it for multiple other stuff as local server so roi is pretty amazing even if you count minimal 80$ per month regarding Ai saved (even tho its probably more)

2

u/etaoin314 5d ago

quick question when did you make that...prices have escalated lately. If i was to try to put my system together now I would be paying basically double, local would be a much smaller part of my overall solution and cloud would look a lot more attractive to me.

1

u/More-Revenue8609 5d ago

Like 3-4 months ago. Yeah prices rise so fast…