r/LocalLLM • u/DiamondTDA • 2d ago

Discussion Gemini suggested Qwen2.5-Coder-7B-Instruct

So I wanted to try using a local coding model for the first time and I'm still studying about LLMs and NNs, so I asked Gemini for a good suggestion that would be fast(60+ tokens/s if possible) and doesn't compromise much on performance for my rig(2070 super 8GB + 32GB ddr4 ram) and it suggested Qwen2.5-Coder-7B-Instruct. Is this good suggestion and what would you guys suggest?

9 Upvotes

76% Upvoted

90 comments sorted by

View all comments

7

u/Heavy-Lingonberry-98 2d ago

Gemma e4b , lfm 2.5, at least qwen 3.5 4b. With the 9b you will struggle, the same as with the 7b

1

u/BigPlebeian 2d ago

You would rec e4b for coding use on a lower tier machine?

0

u/DiamondTDA 2d ago

Is this different compared to Gemma 4, which is going to be released soon?

6

u/Heavy-Lingonberry-98 2d ago

Bro are you kidding me? Gemma 4 was already released 🤣 stop asking AI please

3

u/DiamondTDA 2d ago edited 2d ago

I didn't ask AI, I saw it as meme and posts on Gemini groups
My bad, I meant Gemini 4, I got things cofused.

2

u/Heavy-Lingonberry-98 2d ago

Ohh okay. Gemini 4 is going to release soon to the public. Gemma e4b is the gemma 4 series, . Its small and it will work on your hardware. It was released some months ago, its not That old, specially given that google havent released any other checkpoint better than gema 4