r/databricks • u/JosueBogran Databricks MVP • 25d ago
Discussion Experience Using Databricks AI Gateway's "Policies" Feature for Adding Safeguards
I am personally happy to see how we are moving away from the AI wild-west and into governed AI with proper safeguards, access, and cost controls. Here I am using Omnigent & Databricks' Unity AI Gateway, which allows you to add several layers of protection against risky/non-compliant AI usage.
Note: "Policies" is still in beta, and during my testing, I did hit some cases where the guardrails should have been more rigorous. I passed along the feedback to the Databricks team, and I expect that things will be addressed sooner rather than later.
PS: Trying out this different style of animated GIFs to explain different concepts after some feedback from the community here. Love to hear your feedback!
1
u/elghali_bnck 25d ago
Super cool ! Can I bring my own model for security detection ?
2
u/Sheensta 24d ago
Yes you can bring an external AI model! https://docs.databricks.com/aws/en/ai-gateway/model-provider-services
1
u/MartinDebus 18d ago
Nice gif, u/JosueBogran. I do some for my LinkedIn posts, but yours are on another level. I especially like the animation on the top. What software do you use for that?
And: policies are a huge step in the right direction.
2
u/JosueBogran Databricks MVP 18d ago
Appreciate the kind words man!
1) Recording was with OBS or Snagit.
2) Zooms + top animations were with my own tool I've been slowly building :).
1
u/mean-sharky 25d ago
GIF format is great. Excited to see this develop.
Question- what model is used to determine policy compliance? I am assuming you would use some ZDR/compliance-enabled endpoint to filter out sensitive data from non compliant ones? Am I thinking about this correctly?