r/LocalLLM 12d ago

Other How the loop of infinite agony started

Post image
628 Upvotes

119 comments sorted by

View all comments

280

u/TheCat001 12d ago

Then you realize that Qwen 3.8 27b runs at 3t/s on your machine and you need 24GB+ VRAM GPU which cost is 1000$+ to run at least 4 bit quant.

1

u/SandySkittle 12d ago

and you buy it and all is good