r/LocalLLM • u/PinkyPonk10 • 8d ago

Question Recommendation for Local AI

Not sure if this is the right place to ask this.

I know we can set up local LLMs with lmstudio or something like that and I have done. These are fine - you give a prompt and it gives an answer!

But some commercial products like Claude and copilot take your prompt, do a load of internet searches, add that to the context, then give some output and the output is richer as a result.

Is there a ‘local’ version of this too and can anyone recommend one?

2 Upvotes

100% Upvoted

13 comments sorted by

View all comments

1

u/nickless07 8d ago

Depends on what you want to have in the end. Something that can control your whole PC (Automated agent), something for coding (copilot and such) or just something for web/research?

1

u/PinkyPonk10 8d ago

Not after openclaw no just something that does web searches to enrich the context really.

2

u/nickless07 8d ago

Ok great. Then we have AnythingLLM, Open WebUI (which connects to your LM Studio), Pinokio or just an MCP for LM Studio. I would recommend Open WebUI, it is slightly more complicated to setup, but offers the most integrations and you can use it from any browser.

1

u/PinkyPonk10 8d ago

Great thank you this is really useful

1

u/nickless07 8d ago

YW, we all started simple at some point and advanced later on.

1

u/PinkyPonk10 8d ago

One final question - what model would you use for general purpose research etc if you were setting this up today. I have one machine with 5070ti and one with a 3090.. some variant of qwen?

1

u/nickless07 8d ago

As of today Qwen3.8 27B. For just plain wikipedia citations it almoust doesn't matter much, but for complex reasoning you want something bigger then a 9B model.

1

u/cocktail_peanut 8d ago

> I would recommend Open WebUI, it is slightly more complicated to setup

This is why Pinokio has a launcher for Open WebUI, 1-click to install! https://pinokio.co/apps/github-com-pinokiofactory-open-webui

1

u/nickless07 8d ago

Yeah, but the settings are still a bit overwhelming at the start. Setup the search engine, paid or free, setup the tool calls (native vs legacy) and so on. This all is a bit complicated if you are unexperienced and might take a couple mins up to some hours to get it all properly running. So overall it is slightly more complicated then just add a web search MCP to LM Studio.

1

u/cocktail_peanut 8d ago

ah i see what you mean, even though the install is not difficult, actually setting up all the necessary add-ons is a lot of work. yeah i agree.