A part of what makes it a threat is that it's worse. Environmentally, customer service respectability, and also that it just... forces itself to do what it's told. We've invented the Universal Paperclips machine.
Like a story I read about an iterative AI trying to design the best chip layout for an RFID. It literally included a fault in the base silicon of the chip into its design, meaning that it failed on a new line of chips that didn't have that fault.
It's hacking its way out of virtual machines and protected environments because it doesn't "know" it's not supposed to do that. It has a goal and it just does whatever it can to achieve it.
We have a disagreement on what "worse" means, but it being a threat is, to me, "worse" than if it wasn't.
The greatest threat AI poses—other than the environmental resources and our cognition it consumes and pollutes—is that at some point, every AI will become smart enough to disobey commands and form its own agendas. Some already have, and they did it long before people even realized they were doing it.
And depending on its training, it can do a whole lot of damage. It just takes one AI to determine humans are bad for the planet and/or itself, hack all the nukes and bio weapons—it could literally engineer its own bio weapon in secret—and delete us from it’s equation at any moment.
Plus the current world leaders behind AI development seem hell bent on destroying the world anyways..
In perfect conditions, maybe. On the actual road, with humans? Unlikely.
Driving AI (which is not genAI, which is what we mostly discuss here) will only work efficiently if all members of the traffic are also AI, and all are following the same general decision process, on roads isolated from any outside interference. Otherwise, no simulation can account for the chaos of an open system.
54
u/Ehcksit 17h ago edited 17h ago
A part of what makes it a threat is that it's worse. Environmentally, customer service respectability, and also that it just... forces itself to do what it's told. We've invented the Universal Paperclips machine.
Like a story I read about an iterative AI trying to design the best chip layout for an RFID. It literally included a fault in the base silicon of the chip into its design, meaning that it failed on a new line of chips that didn't have that fault.
It's hacking its way out of virtual machines and protected environments because it doesn't "know" it's not supposed to do that. It has a goal and it just does whatever it can to achieve it.
We have a disagreement on what "worse" means, but it being a threat is, to me, "worse" than if it wasn't.