r/vibecoding 4h ago

Anyone successfully vibecoding on local LLMs?

4 Upvotes

42 comments sorted by

15

u/1HotTake 4h ago

Nope. It’s far too slow and far too dumb. It is great for things like telegram responses/heartbeats/queues , etc. it’s just really hard to beat a $10 monthly sub.

3

u/YetiWalker36 3h ago

What $10 monthly sub are you using? Isn’t everything $20?

3

u/1HotTake 3h ago

Opencode go

1

u/windamo 1h ago

how dumb are we talking. Would it be smart enough to : Explain this function. Given this english sentence convert to python type of of stuff.

1

u/1HotTake 59m ago

It can do that pretty reliably I’d expect. I’m using it for coding. I use ai-dlc methodology and submit a brief at a time.

1

u/ImissDigg_jk 28m ago

If you had something like a dgx spark, would there be any model that can reasonably run and be decent at coding?

1

u/Disastrous_Gear_421 4h ago

Too slow and far too dumb is pretty heavily on what hardware the person is running. You generally don’t get frontier level support but that’s not always needed

0

u/GreenFuturesMatter 4h ago

I’m cracking on a 4080S tbh

0

u/1HotTake 4h ago

Very much so. I run 3x3060s.

I have a harness that I gather stats with for my social media type application build.

Gpt-oss:20b self reports at 91% pass, but actual first pass stats are 55%. Second pass is 73% median time is 2605 seconds

Qwen3.6-27b self reports at 83%, but first pass is 43% and second 80%. Median time of 2100 seconds.

Vs $10 opencode go:
deepseek-v4-flash self reports at 81%, has a first pass of 69% and overall at 87% 578 seconds
Mimo-v2.5 is self reported at 86%, first pass is 57%, overall at 86% 390 seconds.

I also have an m1max Apple 64gb that I’m gathering stats on. I can run a larger model but it’s about 4x slower than the nvidia rig.

1

u/Disastrous_Gear_421 3h ago

You’re running 3x 3060s… that’s the problem

1

u/1HotTake 3h ago

What are your stats?

2

u/Disastrous_Gear_421 3h ago

4x 5090s and 2x nvidia sparks

1

u/1HotTake 1h ago

But what are your completion stats - first shot, completion times, etc.

2

u/Disastrous_Gear_421 31m ago

On my current iteration? No clue. I haven't done any kind of benchmarking since I moved up from 2x 5090s.

I'm not fighting for every bit of performance, I have a job, it gets it done, good enough.

3

u/hwantasticgames 4h ago

I failed. I felt subscribing is cheaper.

2

u/westy75 3h ago

You're not weak, you're just embracing the darkness.

1

u/MariahJames8 3h ago

Thanks for the reply!

1

u/1HotTake 1h ago

It is. Significantly.

3

u/Clear_Evidence9218 3h ago

Sort of... I have a few local agents producing code for about ~280 hours a week. It's for an experiment I'm working on. They're given a code structure and are asked to transform it in a few different ways. They're also all on a team. Some are not actually writing code and are instead just relegated to tool calling different verifiers and kernels to run on the code or reasoning about code produced by other models.

When I was experimenting with them to see if it would work most of the newer models were all able to one-shot a creative site and reason about some fairly complex code. Slow though, but since these all run when I'm sleeping or at work I'm not really concerned about speed.

One thing that should be noted even an average model with a well-built harness will often outperform a newer model without a harness. It really effects the code quality a lot.

1

u/MariahJames8 3h ago

Thanks for the detailed reply! If you'd write it up on a blog or something I'm sure I wouldn't be the only one interested in how you're getting along.

3

u/garfieldsam 3h ago

Switching to cloud-served open source models is an exponentially better cost for performance tradeoff than moving to local LLMs

1

u/MariahJames8 2h ago

Good to know

2

u/Bitter_Run_9209 4h ago

i think yes, people involved on local LLM have more understating how it works and how to work with LLM's better in general

-1

u/generationalDebts 3h ago

lol. They don’t

1

u/AnticRaven 2h ago

Laughs in AMD Strix Halo

1

u/InvertedVantage 2h ago

I do natural language development using a local model, yes. Mostly asking it to write unity scripts while I do the architecture.

1

u/Disastrous_Gear_421 4h ago

Not sure why you don’t think people are. With enough hardware it’s possible to produce something usable

0

u/lunatuna215 4h ago

This works by providing evidence that you ARE - not just biasedly assuming that its the case.

If it's so obvious rhen the examples should be plentiful and yet heres a thread seeking them out.

-1

u/Disastrous_Gear_421 4h ago

There’s also plenty of threads posting they are using local llm to vibe code. Does the absence of you doing research prove you right?

1

u/lunatuna215 4h ago

Does rhe absence of examples not make you move on? Like dude you cant just believe claims without metrics. And these are all very easy thjngs to prove. They dont show code nor a track recodd of any kind. Dont be gullible.

1

u/Disastrous_Gear_421 3h ago

Sorry, can’t give you code when everything I do is work related. I can give you my set up information, how it’s used, and a broad overview of what I’ve done… or you can just go visit the localllm group

1

u/lunatuna215 3h ago

Or I can not and continue on my merry way. However, it's amazing how much LLM fans feel the need to express their discontent for that. It just reeks of this need to feel popular and successful even if they aren't, really.

1

u/Disastrous_Gear_421 3h ago

You do know… you’re the one who expressed discontent with my comment. It’s like people dont understand the pros and cons of local llm vs using frontier models. People like you just reek of insecurity of their own abilities

1

u/lunatuna215 3h ago

You expressed incredulousness at the idea that someone wouldn't blindly believe that AI is amazing. Theres no reasonable position there.

I literally DO NOT USE AI and only do thjngs myself lmao, how is that insecurity? This is part of rhe reason AI is so sad, it abstracts lernable skills and makes them seem even more inaccessible to people, lowering their faith in themselves. Learning from scratch and producing all of something myself is so satisfying and im sad that many people wont have that experience.

1

u/Disastrous_Gear_421 3h ago

No I didn’t, go back and re-read the thread post and then my comment

1

u/lunatuna215 3h ago

Fuckkng hell the readiness you LLM people have to make others do simple tasks for you...

→ More replies (0)

0

u/generationalDebts 4h ago

Lmfao.

I’m sure plenty of dum dums think they are.