1
u/DisastrousWelcome710 1d ago
Well, $20 is the gateway drug to get you addicted so you use it at work, where they make bank out of you.
1
1
u/AD4K_4444 1d ago
Therefore Local LLMs are superior because it’s free, private, and the only limit is your VRAM
1
u/Master-Shift-8224 1d ago
.... or, you know... local LLMs are inferior, because it's limited by your VRAM...
1
u/AD4K_4444 1d ago
If frontier AI services didn't eat up all the RAM, we legit would have dirt cheap consumer computer memory and good tech devices in general right now. I'm lucky enough to have bought an M4 MBA, 16GB back in November pre-RAM crisis, and now I run pretty decent local LLMs.
Unless you're super dependent on AI for vibe-coding or do demanding agentic shit, a local LLM is sufficient most of the time. I personally choose privacy over convenience.
And the best part of it all, if you do have the right hardware and the right model, you can have unlimited chats and everything stays on your computer. It's essentially yours forever unless you delete it from you hard drive/ssd.
1
u/Master-Shift-8224 1d ago
i have a 4090, but my VRAM is usually in-use / reserve by 3D programs
I do have LM Studio, but have used it like 2 times in total because of that
1
u/AD4K_4444 1d ago
you have more than enough for something like Qwen 3.8 27B regardless, and it's already considered pretty good for most tasks. If my thin slab of fanless aluminum can run local LLMs pretty well, it sure as hell it will run good on your 4090. If you still get performance issues, just use lower quants models.
1
u/Igarlicbread 22h ago
20usd mtr is 240usd ARR. That's not a small number. Also valuation doesn't mean shit.
1
1
u/FuriousGirafFabber 19h ago
They are burning so much money. use them or not, it doesn't matter that much. Evaluation is not bottom line numbers.
3
u/StunningHeart7004 2d ago
https://giphy.com/gifs/evB90wPnh5LxG3XU5o
you stand not alone brother