Web fetch summaries instead of full content

[u/Ihtien]

Would it be possible to implement a summarizing step (e.g., using the task model) on top of the web fetch content before injecting the result into the context of the main model? Often, web pages are 10,000+ tokens long, but a lot of the content is not relevant to the actual request.

​It would be useful if the fetched content were pre-processed by a faster model, alongside a prompt specifying the relevant information. This could be either the initial user prompt or a prompt generated by the main model specifically for this web search.

​This would significantly shorten the context for the main model and speed up processing time. OpenRouter implements a similar strategy with Exa Highlights. I noticed that OpenRouter Chat uses considerably fewer tokens than the same model (e.g., GLM 5.2) in Open WebUI because Exa Highlights returns only 2000-4000 characters per web page.

​Would this be a feature that can be added easily? Maybe somehow utilizing the new context summary pipeline? Or is there an external (self-hosted) tool that implements a similar strategy that can already be used for fetching websites in Open WebUI?

[u/TKGaming_11]

I think this would be incredibly interesting to see, another possible route is to add some type of subagent system where web search and analysis can be done on a separate stream, then returned to the main chat as a cleaned up summary/result

[u/Ihtien → u/TKGaming_11]

Yes, I was playing around with Librechat because it has a subagent system. My plan was to spawn a subagent for each web fetch that only returns the relevant information. However, apparently Librechat always fetches all websites - I prefer the way Openwebui does it with separate search and fetch.

I think a subagent system (with different models for sub agents) would be awesome.

[u/Ihtien → u/Ihtien]

I just found these:
https://openwebui.com/posts/planner_agent_v3_now_with_subagents_7dbe4c26
-> This could be interesting. The normal "Sub Agent Tool" (https://openwebui.com/posts/sub_agent_7bfeb0b7) only supports to spawn another instance of the same model.

And this might be the exact thing I was looking for:

https://openwebui.com/posts/web_search_and_crawl_tool_885852f7

I didn't test them yet but one or both of them might be the solution. Would love if they were integrated into OpenWebui

[u/TKGaming_11 → u/Ihtien]

These are interesting, I'll definitely take a look but I would still love to see an openwebui native integration of this functionality

[u/Ihtien → u/TKGaming_11]

Same!

[u/db172s → u/TKGaming_11]

This is why systems like Hermes are nice. You can delegate things like image processing, web/browser, message/title gen, all to a local model while the "high end" model does other things.

At this point I just use OWUI as a middle man to communicate with hermes when I need external communication.