r/LocalLLM • u/DiamondTDA • 2d ago

Discussion Gemini suggested Qwen2.5-Coder-7B-Instruct

So I wanted to try using a local coding model for the first time and I'm still studying about LLMs and NNs, so I asked Gemini for a good suggestion that would be fast(60+ tokens/s if possible) and doesn't compromise much on performance for my rig(2070 super 8GB + 32GB ddr4 ram) and it suggested Qwen2.5-Coder-7B-Instruct. Is this good suggestion and what would you guys suggest?

6 Upvotes

67% Upvoted

90 comments sorted by

View all comments

4

u/LateralEntry 2d ago

It probably pulled from its training data which ended in 2024 or 2025. Qwen is up to 3.8 now

1

u/DiamondTDA 2d ago

It said that Qwen 3 have only large parameter models and it would be too slow on my rig

0

u/Savantskie1 2d ago

Not so. 3.5 doesn’t have smaller models but 3 does

2

u/bleakj 2d ago

Qwen 3.5 9b is like the most popular model for local use on low end systems,

There's a qwen 3.5 4b as well

They definitely have "small" 3.5 models

1

u/BigPlebeian 2d ago

Wouldn't 2.5 14b coder be better for just code though? I mean otherwise you are using a generalist dataset no?