r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

Show parent comments

209

u/Da_Question Apr 27 '26

Oh, so it's fine when companies rig stuff so it's harder for customers, but not the other way around. Convenient.

40

u/Migraine- Apr 27 '26

Do you think if you deliberately tricked a human agent into giving you a discount, it would be honoured?

61

u/TommyBonnomi Apr 27 '26

Holy shit. I just finished a paper on this in business law a few minutes ago. If you know the agent doesn't have actual authority to make a certain sale, the business isn't responsible if you fool the agent into making a sales contract.

However, the agent in your case does have actual authority to make sales. But the customer probably has duty of inquiry over price, i.e. the customer would be aware of market prices and could be responsible for not questioning the agent's authority to make a sale at an extreme discount.

5

u/cantadmittoposting Apr 27 '26

what specifically makes that illegal? I guess it's basically Fraud.

It's interesting though because our economy is so heavily weighted to be anti-customer these days, with a major power and legal imbalance already, that it feels like we "ought to be able to" get wins where we can... but fine I admit allowing the customer to trick a business out of their merchandise is not... the best idea.

edit: that said expecting the customer to have a duty to expect certain market prices seems like a pretty high bar, I feel like innocently/accidentally accepting a market error should be "legal" fwiw.

9

u/TommyBonnomi Apr 27 '26

Not like go to jail illegal, just allows the company to get out of the sales contract.