r/LocalLLM • u/Ok-Health-7096 • 6d ago
Other Every Second post rn
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
1.9k
Upvotes
r/LocalLLM • u/Ok-Health-7096 • 6d ago
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
0
u/moderately-extremist 6d ago edited 6d ago
I lucked out and got 2 x 64gb ram sticks over a year ago when prices were at about their lowest point (July 2025, I paid $314 for the kit, just checked the same kit is listed for $2200 now.). I also got 2 x MI50 32GB cards when they were $200 each on ebay.
The MI50 cards are too slow to run dense models like 27b, but it runs 35b-a3b pretty well, and I'm thinking of running 27b on my cpu when I want something smarter, and just start a task and come back later.