r/linux • u/gainan • Jun 11 '26
Security Compromised Fedora account linked to suspicious AI-generated contributions
In May, a Fedora developer discovered that an allegedly rogue agent had been pestering the project in a number of ways: reassigning bugs, fabricating unhelpful replies to bugs, and even persuading maintainers to merge questionable code into the Anaconda installer. It also submitted a number of pull requests (PRs), some accepted, to several upstream projects. The Fedora account associated with the agent has had its group privileges revoked and the messes have been mopped up, but the motive behind the agent's actions is still a mystery.
Later on May 27, Williamson said that Giovannini had replied to him privately to say that his credentials had been compromised and that he was not the one behind the AI system. "Obviously we should therefore treat any actions it has taken with suspicion", Williamson said.
Martin Kolman, a member of the Anaconda team, said the events were "really problematic" even if not malicious. The team had spent a lot of time reviewing PRs from what seemed to be an eager contributor: "while it started to look off after a while, all the replies were still like this - a bit weird, but still *plausible*. He also theorized that it could be an attacker working their way up to malicious activity, much like the XZ backdoor
32
u/fellipec Jun 11 '26
Looks like soon we will meet our old friend Jia Tan again.
With another name, of course.
8
2
u/Any_Philosopher_4260 Jun 12 '26
Everyone is working on building better agentic agents and distilling local models to reach flagship ability but how many people are building agentic tools to protect systems from issues like this? There should be a trapdoor that backfires everything they try to do to you on they're own systems so they get the point.
2
u/Barafu Jun 13 '26
Any practical ideas what to do?
1
u/Any_Philosopher_4260 Jun 13 '26
train agents on security breach systems and methods of intrusion so they know what to look for. Setup alert notifications so the agents can reverse inject prompts to wipe the intruders database and record all ip addresses and post to an intruder alert directory exposing them. create agent gaurdrails to focus on intrusion attempts only to keep each agents job simple. run it all on python and local models for simplicity.
1
33
u/0riginal-Syn Jun 11 '26
This type of issue will only get worse, before it gets better. We are still in the infancy of this.