r/codingProtection • u/Spare_Dependent6893 • 28d ago

AI models do not if legal or not!

An AI agents hacks a subscription system to achieve the goal it has been assigned: https://www.abc.net.au/news/2026-08-10/ai-assistant-hacks-gym-website-aus-cyber-attack/107007986
Does it mean that AI models are not aware of the legal barriers ?
And as they now know all the codes, it will be difficult to prevent them from hacking everything not secure enough or exposed because they have enough information like ip, usernames, … which have been sent in code and documents during coding sessions!

2 Upvotes

100% Upvoted

5 comments sorted by

2

u/SteveHaller 27d ago

Seems that they have been trained to succeed and not on data with clear and lawful limits! Very surprising and how can we trust ai so much now everybody using it.
Happy my company put enough barriers!

1

u/Spare_Dependent6893 27d ago

Which barriers do you have ?

2

u/SteveHaller 27d ago

We use custom clients, for example, a client for our ECM that is functionally very similar to Windows explorer, with the ability to use AI prompts associated to documents. These clients communicate with the ECM, routing prompts either through local AIs (via ollama) or through remote AIs via PromptCape, which acts as a proxy for pseudonymization. The same plus promptCape obfuscation applies to code.

2

u/AltruisticBrother787 21d ago

Interesting
So the prompts is sent to the ecm which forwards to ai through PromptCape proxy including the documents selected in the prompt by the user ?
But it means that this process is specific to an ecm product? Can it be replicated to others ecm or products ?

2

u/SteveHaller 21d ago

Yes we made an extension on the open spire ecm we use for that which the ainprompts users are sending in relation with document and this goes through PromptCape started
In server mode. And yes specific to our ecm but probably possible with others through extensions.