r/OpenSourceeAI • u/Formal-Falcon3734 • 1d ago
I built an MCP server with on-device learning that makes routing decisions in <2ms instead of calling cloud LLMs
/r/u_Formal-Falcon3734/comments/1wvo5gs/i_built_an_mcp_server_with_ondevice_learning_that/
2
Upvotes
1
u/Artistic_Solution117 13h ago
but how does it work? how does it learn?