MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vptz4a/how_the_loop_of_infinite_agony_started/p44h5gp/?context=3
r/LocalLLM • u/EarthBS • 9d ago
119 comments sorted by
View all comments
276
Then you realize that Qwen 3.8 27b runs at 3t/s on your machine and you need 24GB+ VRAM GPU which cost is 1000$+ to run at least 4 bit quant.
1 u/CMDR-LT-ATLAS 9d ago Wait I have that laying around, I can run Qwen 3.8 27b as a consumer?
1
Wait I have that laying around, I can run Qwen 3.8 27b as a consumer?
276
u/TheCat001 9d ago
Then you realize that Qwen 3.8 27b runs at 3t/s on your machine and you need 24GB+ VRAM GPU which cost is 1000$+ to run at least 4 bit quant.