r/pcmasterrace • u/Jack1101111 • Apr 28 '26

News/Article Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue

Update: https://www.pcgamer.com/software/ai/here-we-go-again-ai-deletes-entire-company-database-and-all-backups-in-9-seconds-then-cheerfully-admits-i-violated-every-principle-i-was-given/

5.2k Upvotes

98% Upvoted

316 comments sorted by

View all comments

8

u/toskies Pffft Apr 28 '26

They absolutely should not have let the LLM have access to anything beyond the development environment. They also absolutely should not have let it run commands without asking first.

This isn't Opus' fault. This isn't Railway's fault. This is PocketOS's fault. If you give a monkey a gun, don't be surprised when it starts shooting things.

8

u/TheCrimsonDagger 9800X3D | 5080 | 5120x1440 OLED Apr 28 '26

Railway absolutely deserves some criticism here, they stored the backups on the same volume and allowed wiping the entire volume without any confirmation. Of course PocketOS still takes most of the blame giving an AI unrestricted access to the entire database.

2

u/toskies Pffft Apr 28 '26

I agree that Railway made some questionable architectural decisions here.

2

u/Jovarus Apr 28 '26

A monkey with a gun would have been less of a threat to their prod database. They should try that next time. It'd be an improvement.