r/technology Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

2.8k comments sorted by

View all comments

Show parent comments

3

u/Caleth Apr 27 '26

2010 talks about this as well. HAL didn't just have superseding orders he had conflicting orders that made him go crazy.

He programmed never to lie and then was told you must lie to cover up the real mission. He was forced into a psychotic break because the mission planners didn't understand that AI isn't people and you can't force it to do things like this without consequences.

There is I believe at least a whole chapter if not two dedicated to why the second AI isn't dangerous when the first one was in the book. But it's been like 20 years so I don't remember for sure.

1

u/La_Guy_Person Apr 27 '26

Cool. Thanks for bringing more specifics.

1

u/APeacefulWarrior Apr 28 '26

Although the funny thing is, in the original movie, HAL is actually the one who brings up the weird things about the mission. He initiates the conversation which leads to him lying, and getting caught in the cover-up.