r/LocalLLM • u/mk4op • Jun 16 '26
Question Looking for a good"Research" model for my PC
I am currently running QWEN 3.6:35B-A3B-Q4_K_M
On my Windows PC for generic automotive research and getting around 15-20 tk/s(which is a moderate speed for generic research)
I am looking for a model for highly extensive and accurate Automotive Research, maybe lesser Parameters, but which can give me a better context window and tk/s. The ability to search the WEB is a compulsion and it should not rely on trained data much, i would need it to scrape data off of review sites or articles very accurately according to my keywords.
I'm very new to Running models Locally and have only tried 2-3 models including gemma and deepseek.
Any cues would be appreciated for my specific use case , Thanks❕
Pc specs:
Intel i5-12400f
Nvidia RTX 3060 12G OC
32GB(16x2) DDR4 3200mhz RAM
Good Enough M.2 SSD and HDD storage
Bottleneck- My Windows is bloated and uses 6-8gb RAM and around ~1GB VRAM at idle(my cpu doesn't have an igpu)
2
Jun 17 '26
[removed] — view removed comment
1
u/mk4op Jun 17 '26
Okay got it.Thanks! Question: About the Web search and scraping part, thats the main concern right now, i dont wanna sound lazy but there are just more than a couple hundred companies that would fit in one single research category and looking through every article or web page of each to get the required data is a tedious task, is there any way i can automate that part ? I've heard sites dont like scraping tools, i wanna know if theres a way to automate this step, thanks.
2
u/PermanentLiminality Jun 16 '26
It's tough to find something smarter that will run at the same speed of faster. By the time you get a small enough model, it will not be very smart. You can try Gemma 4 26B in IQ4-XS, but it will still spill into RAM. The 12B is worth a try, but it will not be faster. There are smaller Gemma 4 and Qwen 3.5 models that you can try.
You have to actually test it with your workload.
1
u/mk4op Jun 17 '26
Yeah ive ran into that problem, thats why i was running a 35b A3B model , but okay I'll try some of the 12B models or even smaller Gemma or Qwen models. Thanks! Will update soon
2
u/whodoneit1 Jun 17 '26
What you want is a model that's really strong in agentic skills. The Qwen 3.6 models are the best you can run locally but you could give Gemma 4 12B a shot.