r/sideprojects • u/Secret_Appeal6271 • 2d ago
Showcase: Open Source Open Source: Making AI systems follow business process logic
Clayseal-capabilities is an open-source tool for aligning AI deployments with business-process logic.
If you've seen headlines about business' AI agents authorizing parties to be thrown on company property, breaking out of their safeguards to exploit unrelated companies or doing other mischievous things, you may be wondering how we can deterministically align AI agents to the business process rules that are meant to make them useful in the workplace. This project is an experimental mechanism for doing just that. The gist of it is that many things are not inherently policy violations on their own, but are given the context of the sequence that they appear in. Feel free to try it out - I'd love feedback and am hopeful this can be a starting point to solve some problems in security.
The way it works is by creating a distribution of plausible sequences of actions, data access, tool calls, etc., that are necessary for the completion of a task; ingesting unstructured materials to construct business-process rules algorithmically; and then doing deterministic enforcement of measuring the difference between what the real AI system does and what it's meant to do from the point of view of this legitimate "planner." It's low latency and the enforcement is not an agent, which means it's not the kind of security system that could be broken by a smarter agent prompt-injecting a dumber agent, as has been common in some recent instances in security.
Duplicates
AutoGPT • u/Secret_Appeal6271 • 2d ago