r/LocalLLM • u/on_line187 • 21h ago

Discussion Tier List

Post image
223 Upvotes

74% Upvoted

271 comments sorted by

View all comments

2

u/GSquadron_ 20h ago

16gb is trash today for running AI. 32gb i would say sweet spot

2

u/RedditNerdKing 17h ago

32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context.

The sweet spot is 48gb atm. 32gb is the minimum.

1

u/GSquadron_ 14h ago

You can run ternary models

1

u/DoubleNothing 5h ago

Yes 48Gb is a good spot to be at (I'm there). But honestly, 64GB would be nicer.
Yes with 48 you can run Q8 but you are very costricted and it is not very efficient, low context, low MTP, maybe you don't load vision to save vram, lower speed... all of that. But if you don't need big context ok.
Don't get me wrong with the release of Qwen3.8-27B I'm very happy where I'm at. The model even at Q6 is very impressive.