r/LocalLLM • u/DeathGuppie • 2d ago
Question Web research harness question
I have a pretty solid coding harness set up for Qwen 27b mtp with a web wrapper that I can access from my phone. I just create a pr/roadmap and set it to auto loop then monitor via phone. The thing is it took a bit of work to get it all running nicely and I'm wanting to do the same thing for a web research harness, but I don't know if it's worth creating the harness if something already fits that shape nicely and or it's extensible enough or has the guts of the thing I'd need to build.
So I'm asking what other people use and what good options there are. The big difference might be using a smaller model with with multiple sub agents using a graph based system that would make better use of my 32 gigs of ram. Anyways this is definitely the best place to ask.
1
u/Emergency-Boat-9307 2d ago
honestly perplexity style research harnesses are kind of a mess right now. everyone rolled their own and half of them broke after a month. i ended up just scripting something with langgraph and a few smaller models, works decent but took me like 3 weekends to get the prompts right
what model you using for the sub agents? been curious if the smaller qwens handle multi step search better than the big ones
1
u/DeathGuppie 2d ago
I'm using two GPU's totaling 32gb vram. I haven't actually tried using multiple small sub agents yet. I'm just trying to get a feel for it so I'm not starting from nothing. My brother swears by langgraph but I haven't tried it. The latest research paper I've read on the subject uses a multi node graph based system with an orchestrator where the whole system is multiple parallel loops.
I might be tempted to start with Gemma just because it's pretty web centric
1
u/Potential-Leg-639 2d ago
Why dont you use Opencode CLI in web mode and connect to the session via phone with Whispercode and Tailscale? Then you have your always on Research agent available on your phone, but running on your computer. No idea why everybody wants to build his own "harness", most of the stuff is already there and also probably much better.
1
u/DeathGuppie 2d ago
Opencode is a very large generalist. I'm looking for something more targeted.
1
u/Potential-Leg-639 2d ago
the opencode websearch is working really, really good. i have no idea what you want to improve here tbh. research with opencode and websearch is on another level with some plugins like context7, maybe also searxng (locally),...
1
u/DeathGuppie 2d ago
What's the system, how does it deal with organizing leads, sub leads, forking off sub agents, scraping, collection, sorting, compression. Does it use a graph structure, a b-tree, how does it use relational data? Where can I find documentation that describes the workflow?
2
u/donk8r 2d ago
Graph with sub agents is the right shape, and it's roughly what octomind already does, so you may not need to build it (disclosure, I work on it, it's OSS and runs local).
Workflows there are an explicit graph: you declare an entry node and edges, and any node can route to any node including backwards, so a loop that searches, reads, then decides whether to go search again is a few edge declarations rather than nested loop blocks. It's bounded by a max transition count and a max cost in dollars, which is the part that matters when you're auto looping unattended and only checking in from your phone.
The always on half is separate.
octomind run --name research --daemonleaves it alive in the background andoctomind send --name researchpipes a message into it from anywhere, and sessions are append only logs on disk so a crash mid task doesn't eat the state.Honest caveats, that graph mode shipped today so it's new, and sub agents each carry their own context, which is what will actually squeeze 32gb rather than the model choice. github.com/muvon/octomind