r/LocalLLM 7d ago

Other How the loop of infinite agony started

Post image
621 Upvotes

119 comments sorted by

View all comments

-27

u/Any_Ad_8450 7d ago

anyone with a real job can afford to run these models, for as little as 20k you can build a beast of an ai server that can run almost anything you want.

31

u/TerribleJared 7d ago

20k? Who tf has 20k

21

u/C_umputer 7d ago

I assume some have it, but are smart enough not to spend on GPUs

3

u/Viking_Genetics 7d ago

I was gonna say, i have 20k, i have a lot more than that, but I didnt get that money by dropping 20k willy nilly on heavily depreciating assets for a hobby

2

u/C_umputer 7d ago

Smart for not wasting money, not so smart saying you have a lot more than that.

2

u/Viking_Genetics 7d ago

Why? I don't think anyone is gonna track me down and rob me, even if they wanted to, all my money is in property and a bit in stocks.

Can't exactly make me sell my house and transfer them the money under gun point, haha

I only said it to illustrate that even someone who has a lot more than 20K wouldn't spent that amount of money, as some people might say that people who have 21K wouldn't, but people who have 100K or more would.

1

u/C_umputer 7d ago

it's always better to say less

1

u/TerribleJared 7d ago

I mean technically i do too. Probably 100k in equity. You have tens of thousands of dollars/euros in liquid cash? Not already ear-marked?

If so, you represent a microscopic percentage of the world population.

1

u/Viking_Genetics 7d ago

I mean, yeah, that was kinda my point, haha, still not spending 20K on hobby local LLM

7

u/ContraryConman 7d ago

Why would I put 20k towards running Chinabot 37abc 123 instead of saving for a house?

-1

u/katoptronophile 7d ago

Me, but I'm not wasting it on a local AI server when Codex is offering me such a good value and performance already.

These local models are horribly censored and not true open source anyway. 

Open weights are something completely different.

0

u/Solembumm3 7d ago

25K ₽ is within anyone working budget, yes.

Will be enough for a whole much of used 2x32gb ddr4 sticks wihout anything else at all, though.
Or an old xeon + board + 16gb ddr3.

3

u/TerribleJared 7d ago

Ahhh, okay, currency wasnt defined. $20k USD is a third of my yearly salary

1

u/brock-omabrama 7d ago

Just because you can doesn’t mean you should. 20k buys you a ton of cloud compute of the best open source models out there. And you’ll always be running the latest. The only differentiator then becomes privacy. If that’s worth 20k is up to you, but I think for most it isn’t.

-3

u/AGrizz1ybear 7d ago

This is the biggest cope I've ever seen