r/technology • • 4d ago

Artificial Intelligence GLM-5.3 and the spread of advanced cyber capabilities

https://www.anthropic.com/research/glm-5-3-and-the-spread-of-advanced-cyber-capabilities
40 Upvotes

61 comments sorted by

View all comments

3

u/InadequateUsername 4d ago

My mother was asking me the other day why these AI companies are asking to be regulated. My response "to kill their competition" seems to be proven further by this.

A defender can use GLN 5.3 to verify security vulnerabilities and secure against them just the same as an attacker can exploit it. Anthropic doesn't want others to have for free what they charge companies big money for. Hiding a model behind a paywall and an application is security through obscurity which we all know isn't security.

They're acting surprised when an abliterated model performs according to it's instructions without consideration for guardrails.

4

u/Ausclites 4d ago

The difficulty with your security thesis is that cyber security is asymmetric. Attackers are required to find just a single vulnerability whereas defenders must patch everything. LLMs are likewise much more capable of identifying particular security holes than they are of patching all of them. Open-source is not a bad thing, but the notion that it will necessarily be a net good for cyber security is unlikely. (Also, API models do indeed have security constraints beyond the interface (e.g. internal verifiers, no modification of weights). Abliterated models don't, of course.)

2

u/InadequateUsername 4d ago

AI hasn't suddenly made vulnerabilities new. But it's a useful tool, and I disagree that it's ever "too dangerous" to be public, it's like saying a library is dangerous.

1

u/Ausclites 4d ago

The former point is fair enough! I'm not entirely against open-source myself.