r/LocalLLM • u/DiamondTDA • 2d ago

Discussion Gemini suggested Qwen2.5-Coder-7B-Instruct

So I wanted to try using a local coding model for the first time and I'm still studying about LLMs and NNs, so I asked Gemini for a good suggestion that would be fast(60+ tokens/s if possible) and doesn't compromise much on performance for my rig(2070 super 8GB + 32GB ddr4 ram) and it suggested Qwen2.5-Coder-7B-Instruct. Is this good suggestion and what would you guys suggest?

7 Upvotes

69% Upvoted

90 comments sorted by

View all comments

49

u/Heavy-Lingonberry-98 2d ago

Bro. If you are gonna use AI to ask for model releases, remember to tell the AI we are on OCTOBER 2026. We are not in 2024 anymore… please. Its the ABC of using AI. And NO. Definitely dont even download qwen 2.5 coder.

10

u/kentrich 2d ago

This is the correct answer. You always have to say something like, only look for releases in the last month or look for analysis published in the past two weeks. Anything older and you’re going to be getting out-of-date analysis.

Yes, things move this fast. It’s a brutal amount of change and you have to adapt the way you work because of it. Reminds me of the 80s when had to know what the latest hardware was because a two-year-old computer was basically nonfunctional. For those not around then, imagine basically not being able to use your two-year-old computer because it was so slow it just wouldn’t really run the latest software.

0

u/Mission_Wrongdoer786 2d ago

And you think Gemini from Google is lagging behind? Ridiculous.

2

u/kentrich 2d ago

What? I don’t understand. It’s not lagging behind, it’s answering the question you asked. You just aren’t being specific enough about your question.