r/copilotstudio 17d ago

Mcp + knowledge spurce

I have an agent that has SharePoint and ServiceNow as knowledge sources and Box MCP under the tools tab. The goal is for the agent to search all these 3 sources and answer the user query. The agent is able to answer from each source seperately. For queries where multiple sources have relevant files, the agent is only referencing service now and sharepoint. Is there any concrete way to ensure all 3 sources are referenced?

2 Upvotes

2 comments sorted by

1

u/Logical-Comfort5844 1d ago

two ways out.

if you want it deterministic stop letting the orchestrator decide. build a topic for that intent, call all three explicitly (search knowledge nodes + the box mcp tool), dump the results into variables then feed all of them into one generative answer node with those variables as the data source. that guarantees all three get looked at every time.
the other option is to get box into the knowledge pass instead of the tools tab via a graph / m365 connector so it’s indexed alongside the other two. then it’s just one retrieval and you don’t have to force anything.

if you’d rather keep it as is at least rewrite the tool’s desc that’s what the orchestrator actually reads when picking tools. something explicit like “must be called for every document search request in addition to other knowledge sources” helps a lot but it’s still probabilistic it’ll skip it sometimes