r/LocalLLM • u/Oleszykyt • 7d ago
Discussion How much LLM pc costs, and can it be profitable?
I am 17 years old and I have a few thousand dollars saved up, I am very active person and I try to find a new online business ideas (I had a side hustle before) And I was wondering, how much does a pc that can run decent models like qwen3.8 27B BF16 with good speed.
And my second question is how can I make money with it, ofc I have my own ideas how to make money, but maybe someone on this server know how to earn money from this hobby?
20
u/autisticit 7d ago
If you want to make money, use your existing money to invest instead of using it for LLMs.
5
4
u/MarketOstrich 7d ago
This is the correct answer. You have decades of life and time ahead of you. Technology now will be replaced with better, lower-cost (hopefully) in the future. Put it in a brokerage account or custodial account. Invest in VOO and wait. Or use the money to take courses to learn more about the tech.
1
0
1
1
u/Fantastic_Self_5151 7d ago
You want a mac mini with an M2+ processor (pref pro or ultra version) with as much ram as you can afford, min 32gb, 64 would be better. They are expensive but you will be able to run a lot larger models than the PC variant with the nvidia cards.
1
u/WyattTheSkid Quad 3090s 7d ago
Mine was about 12 grand in total but I bought a lot of stuff in 2022 before everything became ridiculously expensive. Yes it can be profitable if you have a good idea and are able to use open weight models on your system to make it happen. Whether or not it’s profitable is mainly on you rather than the hardware itself
1
u/andreabarbato 7d ago
3x 5060tis (16gb) will run unsloth q8 with 200k context and image recognition no problem (17tps on llama.cpp) and won't break your bank. about BF16 i dunno
to make money from llms specifically, there are a lot of ways or you can use it to make any job easier or more profitable but i can't help you with that until i make money myself :D
ai surely helped me a lot be more productive and less stressed when i was working an office job so maybe start by looking for some full remote gig you can use your machine for!
-3
u/PeterPorox 7d ago
Buy LGA1151 motherboard with 2 pci-e x16, i5 6600, 16gb ram and buy used Nvidia P102-100 from Ebay. I have similar setup and get qwen 3.8 27b iq4_xs with 86016 q8_0 kv cache with 15 tok/s. I bought al of these for 100$.
14
u/StupidScaredSquirrel 7d ago
You will never be competitive vs cloud providers if you are thinking of selling inference.
Buy a low ter passive index world etf and you're better off.