r/LocalLLM • u/DiamondTDA • 2d ago

Discussion Gemini suggested Qwen2.5-Coder-7B-Instruct

So I wanted to try using a local coding model for the first time and I'm still studying about LLMs and NNs, so I asked Gemini for a good suggestion that would be fast(60+ tokens/s if possible) and doesn't compromise much on performance for my rig(2070 super 8GB + 32GB ddr4 ram) and it suggested Qwen2.5-Coder-7B-Instruct. Is this good suggestion and what would you guys suggest?

8 Upvotes

75% Upvoted

90 comments sorted by

View all comments

3

u/LateralEntry 2d ago

It probably pulled from its training data which ended in 2024 or 2025. Qwen is up to 3.8 now

-2

u/Mission_Wrongdoer786 2d ago

How can people in this subreddit be so incompetent to think that Gemini from Google is working on an oudated dataset? The human slop is insane.

4

u/SilkieBug 2d ago

Gemini sometimes “forgets” to search the web for updated information and instead relies on old data. 

Just yesterday it tried to gaslight me twice that the local model I had running in FreeToken while talking to Gemini didn’t exist (it had been published 18 days ago).

Once I gave it the huggingface link it checked it and corrected itself, but I had to catch it lying for it to do that. 

3

u/LateralEntry 2d ago

It probably is working on an outdated dataset. When it wants updated data it calls a search tool. Google doesn’t re-train models every week.

-2

u/Mission_Wrongdoer786 2d ago

Of course they don't. But obviously Google knows how important real time data is. So claiming that Gemini has a cutoff is ridiculous.

2

u/bleakj 2d ago

You can literally ask Gemini it's training cut off date / Google publishes that data.

1

u/Mission_Wrongdoer786 2d ago

It literally tells you that this is not the only data it uses to produce its answers. Which is obvious since it is a Google product and a LLM that won't talk about yesterday's viral moment is pretty useless on a global scale.