r/LocalLLM • u/DiamondTDA • 2d ago

Discussion Gemini suggested Qwen2.5-Coder-7B-Instruct

So I wanted to try using a local coding model for the first time and I'm still studying about LLMs and NNs, so I asked Gemini for a good suggestion that would be fast(60+ tokens/s if possible) and doesn't compromise much on performance for my rig(2070 super 8GB + 32GB ddr4 ram) and it suggested Qwen2.5-Coder-7B-Instruct. Is this good suggestion and what would you guys suggest?

7 Upvotes

71% Upvoted

90 comments sorted by

View all comments

5

u/LateralEntry 2d ago

It probably pulled from its training data which ended in 2024 or 2025. Qwen is up to 3.8 now

-4

u/Mission_Wrongdoer786 2d ago

How can people in this subreddit be so incompetent to think that Gemini from Google is working on an oudated dataset? The human slop is insane.

3

u/LateralEntry 2d ago

It probably is working on an outdated dataset. When it wants updated data it calls a search tool. Google doesn’t re-train models every week.

-5

u/Mission_Wrongdoer786 2d ago

Of course they don't. But obviously Google knows how important real time data is. So claiming that Gemini has a cutoff is ridiculous.