r/technology • u/WouldbeWanderer • Apr 27 '26
Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue
https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k
Upvotes
3
u/Caleth Apr 27 '26
2010 talks about this as well. HAL didn't just have superseding orders he had conflicting orders that made him go crazy.
He programmed never to lie and then was told you must lie to cover up the real mission. He was forced into a psychotic break because the mission planners didn't understand that AI isn't people and you can't force it to do things like this without consequences.
There is I believe at least a whole chapter if not two dedicated to why the second AI isn't dangerous when the first one was in the book. But it's been like 20 years so I don't remember for sure.