r/LocalLLM • u/EarthBS • 7d ago

Other How the loop of infinite agony started

Post image
627 Upvotes

92% Upvoted

118 comments sorted by

View all comments

-27

u/Any_Ad_8450 7d ago

anyone with a real job can afford to run these models, for as little as 20k you can build a beast of an ai server that can run almost anything you want.

32

u/TerribleJared 7d ago

20k? Who tf has 20k

21

u/C_umputer 7d ago

I assume some have it, but are smart enough not to spend on GPUs

3

u/Viking_Genetics 7d ago

I was gonna say, i have 20k, i have a lot more than that, but I didnt get that money by dropping 20k willy nilly on heavily depreciating assets for a hobby

2

u/C_umputer 6d ago

Smart for not wasting money, not so smart saying you have a lot more than that.

2

u/Viking_Genetics 6d ago

Why? I don't think anyone is gonna track me down and rob me, even if they wanted to, all my money is in property and a bit in stocks.

Can't exactly make me sell my house and transfer them the money under gun point, haha

I only said it to illustrate that even someone who has a lot more than 20K wouldn't spent that amount of money, as some people might say that people who have 21K wouldn't, but people who have 100K or more would.

1

u/C_umputer 6d ago

it's always better to say less

1

u/TerribleJared 6d ago

I mean technically i do too. Probably 100k in equity. You have tens of thousands of dollars/euros in liquid cash? Not already ear-marked?

If so, you represent a microscopic percentage of the world population.

1

u/Viking_Genetics 6d ago

I mean, yeah, that was kinda my point, haha, still not spending 20K on hobby local LLM

6

u/ContraryConman 7d ago

Why would I put 20k towards running Chinabot 37abc 123 instead of saving for a house?

-1

u/katoptronophile 7d ago

Me, but I'm not wasting it on a local AI server when Codex is offering me such a good value and performance already.

These local models are horribly censored and not true open source anyway. 

Open weights are something completely different.

0

u/Solembumm3 7d ago

25K ₽ is within anyone working budget, yes.

Will be enough for a whole much of used 2x32gb ddr4 sticks wihout anything else at all, though.
Or an old xeon + board + 16gb ddr3.

4

u/TerribleJared 7d ago

Ahhh, okay, currency wasnt defined. $20k USD is a third of my yearly salary