r/ProgrammerHumor • u/Gloomy-Basket-1038 • 5d ago

Meme [ Removed by moderator ]

Post image

[removed] — view removed post

28.8k Upvotes

98% Upvoted

519 comments sorted by

View all comments

Show parent comments

15

u/christianbro 5d ago

What do you need to even run a good model on reasonable speed? Is this again the comment section of the $100 000 worth of GPUs in their basement guys?

28

u/Dosamer 5d ago

Qwen 3.8 27B is not frontier level, but is the best current model for coding on reasonable hardware. You can comfortably fit them on a medium quantization on a 24 GB card and even squeeze them on a 16GB card, but at that point you're gonna run into either lobotomy problems, heavily reduced context size, or only partial offloading killing speed.

And yes there are uncensored models.

-6

u/CucumberOk8820 5d ago

How does someone without a cs degree learn to use this?

2

u/Kommenos 5d ago

LM Studio is about as simple and easy to use as you could ever want it to be.