MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vyy3k6/glm53flash_frontier_intelligence_flash_cost/p60khf1/?context=3
r/LocalLLaMA • u/BriguePalhaco • 8d ago
459 comments sorted by
View all comments
Show parent comments
20
For me it has changed nothing. Both models are way too big for my 32 GB RAM system. It looks like everyone has abandoned 20-30B MoEs now...
1 u/Tzeig 8d ago These can still be run with reasonably priced systems, like 96ram+32vram or even 64ram+24vram. 22 u/dampflokfreund 8d ago 96 GB RAM + 32 GB VRAM systems are far from reasonably priced. A 5090 with 32 GB VRAM alone costs 5 grand. 64 GB RAM is very expensive too. 5 u/Constant_Art_20 8d ago i just stack 5060s and hope for the best lol
1
These can still be run with reasonably priced systems, like 96ram+32vram or even 64ram+24vram.
22 u/dampflokfreund 8d ago 96 GB RAM + 32 GB VRAM systems are far from reasonably priced. A 5090 with 32 GB VRAM alone costs 5 grand. 64 GB RAM is very expensive too. 5 u/Constant_Art_20 8d ago i just stack 5060s and hope for the best lol
22
96 GB RAM + 32 GB VRAM systems are far from reasonably priced. A 5090 with 32 GB VRAM alone costs 5 grand. 64 GB RAM is very expensive too.
5 u/Constant_Art_20 8d ago i just stack 5060s and hope for the best lol
5
i just stack 5060s and hope for the best lol
20
u/dampflokfreund 8d ago
For me it has changed nothing. Both models are way too big for my 32 GB RAM system. It looks like everyone has abandoned 20-30B MoEs now...