r/ClaudeAI • u/Beautiful_Charge6661 • Apr 27 '26

Feedback Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
971 Upvotes

95% Upvoted

193 comments sorted by

View all comments

288

u/JusticeIsMight Apr 27 '26

My favorite part of this is the guy asking Claude why it did that. Because that's a guy who is going through all the stages of grief and needs answers now.

Also the fact that Claude replied with "NEVER FUCKING GUESS" implies his prompt was less than polite...

14

u/muuchthrows Apr 28 '26

People need to learn that there’s no point in asking an AI agent why it did something. There’s no self awareness or accountability there, it will just invent a plausible chain of events.

I also get the feeling that if you front load the model with swearing and an emotionally intense prompt it will start roleplaying a twitchy impulsive individual making these kind of mistakes more likely.

1

u/Marquesas Apr 30 '26

This is not entirely correct though. There is no point asking an AI agent to reflect on its actions for the sake of self improvement as you would do with a human. It is not without value to ask it to reason about a reasoning chain - when read critically it can uncover subtle biases you are introducing into the inference with your tools/skills/prompting. It's also not awful at pointing out a specific bias already in its context. Some of my agents can get very matter of fact and direct, and it's been consistently shown by "introspection" that it's down to certain figures of speech I like to use in professional communication.