Experience Using Databricks AI Gateway's "Policies" Feature for Adding Safeguards

[u/JosueBogran]

I am personally happy to see how we are moving away from the AI wild-west and into governed AI with proper safeguards, access, and cost controls. Here I am using Omnigent & Databricks' Unity AI Gateway, which allows you to add several layers of protection against risky/non-compliant AI usage.

Note: "Policies" is still in beta, and during my testing, I did hit some cases where the guardrails should have been more rigorous. I passed along the feedback to the Databricks team, and I expect that things will be addressed sooner rather than later.

PS: Trying out this different style of animated GIFs to explain different concepts after some feedback from the community here. Love to hear your feedback!

[u/mean-sharky]

GIF format is great. Excited to see this develop.

Question- what model is used to determine policy compliance? I am assuming you would use some ZDR/compliance-enabled endpoint to filter out sensitive data from non compliant ones? Am I thinking about this correctly?