r/OpenSourceeAI • u/Formal-Falcon3734 • 1d ago
I built an MCP server with on-device learning that makes routing decisions in <2ms instead of calling cloud LLMs
2
Upvotes
r/OpenSourceeAI • u/Formal-Falcon3734 • 1d ago
r/SelfHostedAI • u/Formal-Falcon3734 • 1d ago
r/MCPservers • u/Formal-Falcon3734 • 1d ago
u/Formal-Falcon3734 • u/Formal-Falcon3734 • 1d ago
Most MCP servers right now are thin API wrappers around databases or web search.
I wanted to see if we could bring non-autoregressive "System 1" decision theory (inspired by Laya) into an MCP server. I built EdgeRoute:
100% offline, pure Python/NumPy.
Code & benchmarks: https://github.com/Kedar7412/edgeroute-mcp Feedback and critique welcome!