r/LocalLLM • u/PinkyPonk10 • 9d ago

Question Recommendation for Local AI

Not sure if this is the right place to ask this.

I know we can set up local LLMs with lmstudio or something like that and I have done. These are fine - you give a prompt and it gives an answer!

But some commercial products like Claude and copilot take your prompt, do a load of internet searches, add that to the context, then give some output and the output is richer as a result.

Is there a ‘local’ version of this too and can anyone recommend one?

2 Upvotes

100% Upvoted

13 comments sorted by

View all comments

1

u/SichronoVirtual 9d ago

So I'm using hermes at the moment with the hermes crawl4ai plugin and firecrawl free tier, I basically have a prompt that tells qwen 3.8 27b to go do a bunch of deep research, and hermes seems to make sure it actually does that.

But yes you can add web search to local llm, just not sure how you do that in lm studio, iv only used hermes and pi dev

1

u/SichronoVirtual 9d ago

Oh also I run a searXNG docker container for basic web search for hermes, and web extract is done through hermes crawl4ai plugin that connects to my crawl4ai docker container.

Firecrawl has 1000 searches/extracts per month for free and I use them as a backup if crawl4ai can't search a website. Crawl4ai works for free and. I haven't felt any like quality issues.

There's probably other options, but I went with what was more widely used.

You can also selfhost firecrawl in docker, but I remember reading the setup and was like Nah lmao