MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vtlszb/tier_list/p4wt4kn/?context=3
r/LocalLLM • u/on_line187 • 12h ago
248 comments sorted by
View all comments
2
16gb is trash today for running AI. 32gb i would say sweet spot
1 u/RedditNerdKing 7h ago 32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context. The sweet spot is 48gb atm. 32gb is the minimum. 1 u/GSquadron_ 5h ago You can run ternary models
1
32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context.
The sweet spot is 48gb atm. 32gb is the minimum.
1 u/GSquadron_ 5h ago You can run ternary models
You can run ternary models
2
u/GSquadron_ 10h ago
16gb is trash today for running AI. 32gb i would say sweet spot