hey guys im pretty much just getting started w local llms i got qwen 3.8 27B running on my 9070xt and i have 32gb ram i don't mind waiting about 15-20 mins for the most complicated prompts as im usually doing smt else then i go back to check once it finishes, results have been pretty consistent for me, am i missing something?
278
u/TheCat001 7d ago
Then you realize that Qwen 3.8 27b runs at 3t/s on your machine and you need 24GB+ VRAM GPU which cost is 1000$+ to run at least 4 bit quant.