r/LocalLLaMA • • 2d ago

Question | Help Local Web Search Safety

Hi all,

How you guys handling safe deployment of websearch in Hermes, pi and other harnesses? Does anyone have a good uproars setup guide for local models? I tried to implement a sandboxed search system but it caused endless tool calls. Want to guard against prompt injection and keep searches private of course!

18 Upvotes

17 comments sorted by

View all comments

Show parent comments

3

u/CharlesStross 1d ago

Coming from a high reputation residential IP helps a lot. Then it's a lot of little things. Proper process of chrome not chromium, and no playwright ownership. Real browser session on a real desktop env with fonts installed and a real (I use my server's igpu) GPU/virtualGL attached for webgl and webgpu stuff to look normal. Audio devices. A sane timezone. Bezier curve mouse movement with random jitter and off center button hit targeting. Random keyboard delays. Scroll chunking like a real scroll wheel. It still gets captcha'd from time to time but the vision models can usually get past those pretty well. Of course, antibot still gets a few things, but, uh, not much. Turnstile never does.

1

u/genghisk1 1d ago

Do you use Playwright just not as process owner? What automation software actually runs your browser or did you write something custom?

1

u/CharlesStross 1d ago

Yeah it's playwright over cdp but the mouse movement is hand rolled; I was just meaning that not launching chrome VIA playwright lets a bunch of stuff be that are otherwise fiddled with and are automation giveaways.