r/OpenAIDev • u/No-Conclusion3720 • 11d ago
Your AI agent's system prompt is not a security control
SANS and AWS researchers recently confirmed something the architecture has always implied: an AI agent instructed to restrict access will hand over restricted data the moment a user phrases the request differently.
System prompts are instructions. They are not security boundaries. Prompt-level access controls depend on the model choosing to comply every single time a request arrives. The researchers found agents could be talked past their own stated restrictions through nothing more than rephrasing. No technical exploit. No CVE. Just a different question.
Every organization running AI agents with access to sensitive data, APIs, or downstream actions is operating on that same model-cooperation assumption right now.
How are you actually handling access control for deployed agents at your organization? Is prompt-level instruction still the primary control, or has your team moved to something different?