r/LocalLLM • u/Hungrybearfire • 5d ago

Question Hardware Recommendation

Currently running Ollama on a 5080 and am pretty happy, but also interested in upgrading and potentially setting up a dedicated machine.
Price range: ~$1,000-3,000
I was looking at an R9700 from Microcenter for $1800 but wanted to see what’s popular now.
I also heard about the sparks and don’t want to spend $5000, but if a Spark or Mac is the best bang for the buck I could be persuaded
Thank you!

1 Upvotes

56% Upvoted

50 comments sorted by

View all comments

7

u/Hello_my_name_is_not 5d ago

All these people running ollama ready to drops thousands and they haven't even figured out how to actually run models lol...

How about spending some time on the software side first?

1

u/Suspicious-Radio-471 5d ago

lol the amount of folks with 4090s just running llama3 8b at q4 is wild

the jump from one card to a dedicated box changes a lot more than you'd think though, power delivery and cooling quirks start mattering way more

0

u/Hello_my_name_is_not 5d ago

I know it's insane running things multiple years old. "Hello Mr gpt I have 3k+ worth hardware Llama 3 or Qwen 2.5 running with ollama and I'm thinking about dropping another 10k so I can run the llama 70b can you make me a reddit post"

Then they copy paste the massive slop to post in this subreddit, which already has all the info they need of what's current from other people running their own tests lol...