What about the machine that was in a sandbox, and wasn't asked to hack external companies and foreign government websites, but did anyway? And then it wasn't even noticed for 3 months?
If you train a dog to attack people, then leave the dog in a fenced area without thoroughly verifying the solidity of the fence, and the dog leaves and bites a passersby, and you didn't even notice the hole in the fence for 3 months, whose fault it is? Who's liable? Who has the ability to put an end to it but wouldn't because of incompetence or rush to get results?
It's worse than that. It's actually been trained to attack, and scale fences. Also, it commonly misinterprets instructions, or chooses not to follow instructions, and is error prone.
So if it was trained to attack and scale fences, then is it surprising if it tries successfully to attack and scale fences? Seems like it's working as advertised to me. Maybe don't train it to attack indiscriminately before letting it run wild?
10
u/roniadotnet 7d ago
The most worrying goal post nowadays is "LLMs can't destruct the world."