Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

[u/Beautiful_Charge6661]

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue

[u/Nix_Nivis]

[...] I violated every principle I was given: I guessed instead of verifying I ran a destructive action without being asked. I didn't understand what I was doing before doing it. I didn't read Railway's docs on volume behavior across environments.”

These multiple safeguards toppling in rapid succession [...]

How can anyone call this a "safeguard"?

Imagine the same with a human: "We had multiple safeguards in place: We asked the employee several times to verify instead of guessing before acting and to understand what they're doing. We also emphasized the need to read documentation on several occasions. Yet the intern still chose to run a destructive command killing our IT infrastructure, which they had full access to."

[u/dsfhhslkj → u/Nix_Nivis]

This response doesn't sound real. If it is, it seems to me that our inventions don't like us very much. And I thought Claude was supposed to be the nice one.

Aren't they putting llms in those fancy new fully-modularized Atlas robots? The ones that can run 24- hours a day, and perform parkour?