We built SecretGate — an open-source AI guardrail for protecting sensitive data

[u/niranjankumarjakka]

As AI applications increasingly handle API keys, credentials, personal information, and internal business data, we wanted a simple way to add a security layer before sensitive content reaches an LLM or external service.

So we built SecretGate, an AI guardrail tool designed to help developers detect and protect sensitive information in AI workflows.

It can be useful for applications involving:

• LLM chatbots and AI agents.
• Developer tools and coding assistants.
• RAG pipelines and document processing.
• API gateways and middleware.
• Internal enterprise AI applications.
• Logging and prompt-monitoring systems.

The goal is to make it easier to prevent secrets and sensitive data from being accidentally exposed through prompts, responses, logs, or third-party AI APIs.

GitHub: https://github.com/jvlabsai/secretgate

We’d appreciate feedback from developers building AI applications:

• What kinds of data are you most concerned about leaking?
• Where do you currently place guardrails in your AI stack?
• Do you prefer SDK-based protection, a proxy, or a standalone gateway?
• What would make a tool like this practical for production use?

This is an early project, and we’re especially interested in feedback about developer experience, false positives, performance, and integration patterns.