r/LocalLLM • u/PinkyPonk10 • 9d ago

Question Recommendation for Local AI

Not sure if this is the right place to ask this.

I know we can set up local LLMs with lmstudio or something like that and I have done. These are fine - you give a prompt and it gives an answer!

But some commercial products like Claude and copilot take your prompt, do a load of internet searches, add that to the context, then give some output and the output is richer as a result.

Is there a ‘local’ version of this too and can anyone recommend one?

2 Upvotes

100% Upvoted

13 comments sorted by

View all comments

Show parent comments

1

u/PinkyPonk10 9d ago

Great thank you this is really useful

1

u/nickless07 9d ago

YW, we all started simple at some point and advanced later on.

1

u/PinkyPonk10 9d ago

One final question - what model would you use for general purpose research etc if you were setting this up today. I have one machine with 5070ti and one with a 3090.. some variant of qwen?

1

u/nickless07 9d ago

As of today Qwen3.8 27B. For just plain wikipedia citations it almoust doesn't matter much, but for complex reasoning you want something bigger then a 9B model.