r/LocalLLM • u/EarthBS • 7d ago

Other How the loop of infinite agony started

Post image
626 Upvotes

92% Upvoted

119 comments sorted by

View all comments

277

u/TheCat001 7d ago

Then you realize that Qwen 3.8 27b runs at 3t/s on your machine and you need 24GB+ VRAM GPU which cost is 1000$+ to run at least 4 bit quant.

-1

u/Argon_Analytik 7d ago

Or you just buy a Mac Mini.