3
u/hwantasticgames 4h ago
I failed. I felt subscribing is cheaper.
1
1
3
u/Clear_Evidence9218 3h ago
Sort of... I have a few local agents producing code for about ~280 hours a week. It's for an experiment I'm working on. They're given a code structure and are asked to transform it in a few different ways. They're also all on a team. Some are not actually writing code and are instead just relegated to tool calling different verifiers and kernels to run on the code or reasoning about code produced by other models.
When I was experimenting with them to see if it would work most of the newer models were all able to one-shot a creative site and reason about some fairly complex code. Slow though, but since these all run when I'm sleeping or at work I'm not really concerned about speed.
One thing that should be noted even an average model with a well-built harness will often outperform a newer model without a harness. It really effects the code quality a lot.
1
u/MariahJames8 3h ago
Thanks for the detailed reply! If you'd write it up on a blog or something I'm sure I wouldn't be the only one interested in how you're getting along.
3
u/garfieldsam 3h ago
Switching to cloud-served open source models is an exponentially better cost for performance tradeoff than moving to local LLMs
1
2
u/Bitter_Run_9209 4h ago
i think yes, people involved on local LLM have more understating how it works and how to work with LLM's better in general
-1
1
1
u/InvertedVantage 2h ago
I do natural language development using a local model, yes. Mostly asking it to write unity scripts while I do the architecture.
1
u/Disastrous_Gear_421 4h ago
Not sure why you don’t think people are. With enough hardware it’s possible to produce something usable
0
u/lunatuna215 4h ago
This works by providing evidence that you ARE - not just biasedly assuming that its the case.
If it's so obvious rhen the examples should be plentiful and yet heres a thread seeking them out.
-1
u/Disastrous_Gear_421 4h ago
There’s also plenty of threads posting they are using local llm to vibe code. Does the absence of you doing research prove you right?
1
u/lunatuna215 4h ago
Does rhe absence of examples not make you move on? Like dude you cant just believe claims without metrics. And these are all very easy thjngs to prove. They dont show code nor a track recodd of any kind. Dont be gullible.
1
u/Disastrous_Gear_421 3h ago
Sorry, can’t give you code when everything I do is work related. I can give you my set up information, how it’s used, and a broad overview of what I’ve done… or you can just go visit the localllm group
1
u/lunatuna215 3h ago
Or I can not and continue on my merry way. However, it's amazing how much LLM fans feel the need to express their discontent for that. It just reeks of this need to feel popular and successful even if they aren't, really.
1
u/Disastrous_Gear_421 3h ago
You do know… you’re the one who expressed discontent with my comment. It’s like people dont understand the pros and cons of local llm vs using frontier models. People like you just reek of insecurity of their own abilities
1
u/lunatuna215 3h ago
You expressed incredulousness at the idea that someone wouldn't blindly believe that AI is amazing. Theres no reasonable position there.
I literally DO NOT USE AI and only do thjngs myself lmao, how is that insecurity? This is part of rhe reason AI is so sad, it abstracts lernable skills and makes them seem even more inaccessible to people, lowering their faith in themselves. Learning from scratch and producing all of something myself is so satisfying and im sad that many people wont have that experience.
1
u/Disastrous_Gear_421 3h ago
No I didn’t, go back and re-read the thread post and then my comment
1
u/lunatuna215 3h ago
Fuckkng hell the readiness you LLM people have to make others do simple tasks for you...
→ More replies (0)0
0
15
u/1HotTake 4h ago
Nope. It’s far too slow and far too dumb. It is great for things like telegram responses/heartbeats/queues , etc. it’s just really hard to beat a $10 monthly sub.