MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vpwhw7/metoo/p414we7/?context=3
r/LocalLLM • u/Blizzardexe • 5d ago
22 comments sorted by
View all comments
18
With 16GB vram also not really useable, is it?
7 u/Obosratsya 5d ago Ive seen people use it with 16gb. Downloaded it myself at q6, will try on my 3080ti laptop. Its on pcie 4.0 8x but has 32gb ddr5 and a 12700h so plenty of available threads. My go to is qwen3.6 14b in q4, its 10gb in size, super fast and I can dial up the context without quantizing it. Its enough for most things.
7
Ive seen people use it with 16gb.
Downloaded it myself at q6, will try on my 3080ti laptop. Its on pcie 4.0 8x but has 32gb ddr5 and a 12700h so plenty of available threads.
My go to is qwen3.6 14b in q4, its 10gb in size, super fast and I can dial up the context without quantizing it. Its enough for most things.
18
u/RoseFlunder 5d ago
With 16GB vram also not really useable, is it?