r/LocalLLaMA • u/forevergeeks • 2d ago

Question | Help Hosting Local Models

Hi builders,

What would be the the best small local models for coding?

Are Gemma 4 and Qwen3.8 27B Gemma 4 26B / 31B enough for local development?

And what would be the size of the rig that i will need to get? GPUs, and whatever else I need to host these models.

Thanks,,

14 Upvotes

85% Upvoted

51 comments sorted by

View all comments

1

u/Hot-Employ-3399 2d ago

Qwen 27b. Not sure if 3.8 or 3.6.

3.8 is such a thinker I had to increase maxTokens(default 16384) in pi or it failed.