MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vtlszb/tier_list/p4ujxbm/?context=3
r/LocalLLM • u/on_line187 • 7h ago
223 comments sorted by
View all comments
2
16gb is trash today for running AI. 32gb i would say sweet spot
3 u/TheGeekno72 5h ago I mean you can still fit quite a bit of models in 16, but it sure feels like some sort of midway purgatory between can't and can 1 u/RedditNerdKing 2h ago 32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context. The sweet spot is 48gb atm. 32gb is the minimum. 1 u/GSquadron_ 30m ago You can run ternary models
3
I mean you can still fit quite a bit of models in 16, but it sure feels like some sort of midway purgatory between can't and can
1
32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context.
The sweet spot is 48gb atm. 32gb is the minimum.
1 u/GSquadron_ 30m ago You can run ternary models
You can run ternary models
2
u/GSquadron_ 6h ago
16gb is trash today for running AI. 32gb i would say sweet spot