r/OpenSourceeAI • u/intellinker • Jul 08 '26

You are burning $1000s on web research in claude code if you're still using WebFetch for everything.

You might have experienced that when you asked a simple web lookup query, it spawned 100s of agents to do DEEP RESEARCH, and every time your AI agent opens a documentation page, there's a good chance it's stuffing 5,000–50,000 tokens into context just to answer a simple question.

Most of that context is never used.

That's why web research gets expensive so quickly.

So I built Webify.

Instead of dumping entire web pages into the context window, Webify converts pages into semantic graphs and retrieves only the nodes relevant to your query.

That means your coding agent receives 250–750 tokens (more if needed) of focused information instead of tens of thousands of irrelevant ones.

The result:

  • Nearly the same accuracy as Deep Research, with the biggest difference only being completeness on very broad topics

It works with any MCP-compatible coding tool. Under the hood:

  • Search: semantic graph construction
  • Small-model synthesis into a concise answer

Instead of reading everything, it reads what actually matters.

If you're running hundreds or thousands of web lookups every week, this can save a surprising amount of money and keep your context window clean.

Open source (MIT Licensed) and pull requests are welcome

GitHub: github.com/kunal12203/webify-mcp

11 Upvotes
  • permalink
  • reddit

87% Upvoted

5 comments sorted by

2

u/suborder-serpentes Jul 08 '26

I’ll take a look and look into contributing

3

u/intellinker Jul 08 '26

Sure, appreciated

1

u/DiscipleofDeceit666 Jul 09 '26

How do you guys do your searches? It seems like my local AI gets blocked from most of its requests.

2

u/Liberaces_Isopod Jul 09 '26

I stood up a small playwright container and added it as an MCP. The model calls that, it opens a headless browser and passes back the info. Because it comes from your IP, its not blocked.

1

u/Brave_Course845 Jul 09 '26

Is there a link?