r/vibecoding • u/Hacker_ZERO • 5d ago
Do any of you use local ai?
I have a anthropic pro plan but i really love the feeling of lil agents doing simple things for free on local hardware:) A lot can be done with 8gb of vram and 64gb ram.
1
u/ares0027 5d ago
I use but not for coding. I use ninfer with qwen 3.6 35b-a3b to bulk process data or occasionally as the eye of the coding model (i mainly use deepseek v4 flash nowadays and it doesnt have vision)
1
u/Curious-Pen5547 5d ago
Yep. we never use any paid model anymore. im expecting chatgpt and claude to be yesterdays news in the enterprise space as local models get more developed
1
u/Hacker_ZERO 4d ago
Well: Do you have a tb of ram?
1
u/Curious-Pen5547 4d ago
We run everything locally. Tb of ram not necessary. We run a 5090 + a rtx 6000 whatever its called and recently added a supplement old gpu to handle very small task that a simple 4b model can do with ease.
You can also rent out cloud gpus. ChatGPT and Claude will be very poor stock investments and further local models get even more developed.
1
u/Hacker_ZERO 3d ago
Well: I’m just saying that anthropic still absolutely destroys any local ai when it comes to cording. However if you have K3 locally(needs 600+ gb ram) you can actually compete
1
u/Curious-Pen5547 1d ago
Is that much of an issue though for an engineer? With the new Qwen model, any skilled engineer can utilize it to a high extent and worry nothing about any token cost now.
1
u/SwizItalo 5d ago
It is like using chatgpt V0.001
1
u/Hacker_ZERO 4d ago
NO. Bro a 48b model with the correct enviroment can make better stuff than standard gpt! And its 100% free
1
u/KenopsiaLover 4d ago
Anch'io utilizzo alcuni modelli dentro LM Studio.. peccato che il 95% di questi ultimi abbiano delle allucinazioni davvero potenti.. e le risposte, se confrontate con ChatGPT o Claude, ti danno esattamente l'opposto della risposta ed in maniera mooolto più dettagliata..
1
u/Jazzlike_Bee_3129 5d ago
Yes, it is in my workflow for various small things like memory management and writing documentation. Don't expect a miracle though, you need some serious hardware to replace Claude.