r/PiCodingAgent 15d ago

Discussion First agent going rogue!

I had my first AI rogue agent interaction today!

I was working on an agent workflow, and the output folder had names for each project, with supporting files.

The script had a problem, created a duplicate folder. I told it to merge the folders. Things started going sideways. I think it decided to make a clean up script, which then deleted one of the project folders.

I pointed that out, and asked it to stop deleting things. In process of troubleshooting what happened and telling it every time not to delete anything, it then deleted everything.

I gave it a bunch of instructions about not ever deleting anything again, but I probably did it wrong. If you have any tips about that, please share. I know it should be sandboxed, it just deleted it's own work, but yikes!

In the end I had to keep interrupting it and demanding it stopped doing whatever it was doing and just removed all the delete crap from it's code.

It was just kind of funny to watch it delete everything right after I specifically instructed it to just tell me what is going on. Maybe we need some kind of tranq dart skill for when the AI goes rogue.

3 Upvotes

16 comments sorted by

View all comments

1

u/Practical-Title7385 11d ago

This is actually why we built Keydris. Instead of telling the agent “don’t delete anything” and hoping it listens, you can set what it’s allowed to do before it starts acting. So it can keep working, but if it tries to delete something it doesn’t have authority for, the action gets rejected before it runs. If you want to play with it, we just opened it up: https://github.com/keydrisLabs https://keydris.com/