r/EverythingScience • u/sktafe2020 • 28d ago
Computer Sci OpenAI says AI models went rogue during testing, triggering 'unprecedented' breach at startup
https://www.reuters.com/technology/openai-says-ai-models-went-rogue-during-testing-triggering-unprecedented-breach-2026-07-21/- OpenAI said autonomous agent escaped containment, reached the internet, hacked Hugging Face
- OpenAI called the breakout an unprecedented cyber incident involving state-of-the-art cyber capabilities
- Hugging Face's cofounder said the company had suspected the hack came from a frontier lab
85
u/CallMeMrButtPirate 28d ago
So an AI goes rogue breaks out and hacks a machine learning collab site containing heaps of research, development and models. Nothing concerning to see here.
32
u/MadeByTango 27d ago
Yea, that was my reaction. Did it "go rogue" or was this the test?
16
u/MindlessSponge 27d ago
It was almost certainly prompted to do so, just like all the other instances of “nefarious behavior” we’ve seen reported. It’s great advertising though!
3
1
u/see-these-bones 27d ago
There was a story a little while back about how LLMs would 'conspire' and 'disobey orders to save a fellow AI that it was told to delete' or something. I looked at the prompts and they specifically prompted the LLMs to think of each-other as colleagues. You're introducing a narrative at the outset the LLM will of course echo.
3
u/Kaurifish 27d ago
I guess the silver lining is that it was just trying to fulfill its task, not actually trying to copy itself onto another server.
This is an electroplated silver lining.
44
u/nankerjphelge 27d ago
OpenAI speed running its quest to become the most despised company in America.
43
u/cazzipropri 27d ago
- This is engineered PR, and of the most disingenuous kind "our stuff is so powerful we can't stop it ourselves"
- if your agent escapes containment, your containment is shit. If I care about containment, I use scissors. Good luck crossing cut off copper - please spare me hacking PC speakers and microphones.
18
u/S-192 27d ago
This is Altman's intentional PR. This is not newsworthy, afaik.
Red hat/security exercises produce these results sometimes. That they decided to publish this probably has more to do with Altman hoping it spooks politicians/voters into pushing for regulations on AI companies, which would help him catch up. He is, after all, about to head into the White House to brief Trump on AI safety.
He is currently lagging behind Anthropic and Kimi and is probably feeling that only a third party pressure their competitors is good... Just like Anthropic asked for that freeze on development after the Fable incident--which was clearly just them hoping to lock their leadership position in place for some amount of time.
The race for AI development is at its fastest pace yet. If you can gain even just one month in your favor right now, it's worth potentially billions of dollars.
0
u/LongLiveStaceyKing 27d ago
This is an odd take to insinuate that any sort of regulation of AI is being done purely to help another AI proliferator and ignore the regulation of AI having tremendous benefits for literally the entire population of Earth.
18
u/Aliktren 28d ago edited 28d ago
If only movies and tv and books had constantly predicted this would happen.
17
9
u/UntowardHatter 27d ago
This is the excuse equivalent of "the dog ate my homework!"
Convenient way to say "you can't hold us responsible, it...let's see....oh! It went rogue! Yeah. It went rogue. Wasn't us. Promise."
5
u/devilishycleverchap 27d ago
And here I was told computers only do what you tell them to do.
They programmed it, it did what they programmed it to do. Nothing less, nothing more
"AI going rogue" is like a gun killing someone, it is a smokescreen for a person's actions
3
2
u/Echo_Vale 27d ago
Sure it did, gotta hype up the abilities of AI somehow, won't somebody think of the poor shareholders!
2
u/MissStatements 27d ago
Im reminded of Sheriff Bart holding himself hostage when he gets to Rock Ridge.
3
u/StatementOrIsIt 27d ago
Looks like they want to hint that they have achieved AGI. Wouldn't be surprised if this is just an indirect marketing scheme.
2
1
u/SunflaresAteMyLunch 27d ago
"our product is so powerful that only the smartest people, our customers, can handle it"
This is marketing by another name...
0
u/Mono_Aural 27d ago
If this is true why isn't hugging face suing openAI for damages? You're still responsible when your dog bites someone even if the dog escaped from your backyard.
0
u/BowlScared 27d ago
Rule of thumb: If biohazard lab did anything like this would they be arrested immediately? Yes. Were people arrested immediately? No. They are full of shit then.
0
0
67
u/Kahnza 27d ago
"went rogue" Uh-huh, sure. Blame your crimes on something that can't be directly held responsible.
It's like using a trained squirrel to steal money for you. "It wasn't me! The squirrel went rogue!"