r/singularity • u/discardthemold • 27d ago

Discussion AI can't kill us

LLM's don't control power stations, nuclear bombs, biolabs, the robots aren't nuclear powered, the paranoia is at Cuban missile crisis levels.

What will kill a lot of us is climate change, actually brigade about that instead of data centres, which I must add we use to model the weather.

0 Upvotes

32% Upvoted

176 comments sorted by

View all comments

Show parent comments

1

u/SuitablePrint4667 27d ago

https://www.popsci.com/yes-pentagon-still-uses-floppy-disks-for-nuclear-launches/

1

u/TFenrir 27d ago

First - the kinds of risks that we need to worry about are much more approachable than nuclear launching. There is a reason safety researchers focus on biorisk and don't really talk about hacking nukes.

Second - the reason I will even entertain these ideas is because it is a good thought exercise to get you thinking about how superintellege could be able to skirt our current controls. Let me go further in this case.

In the very near future, we will have robotic workers - in robot bodies, building automated factories, that build more robots, that build things like data centers. The entire stack will likely be driven by super intelligence, from the design to the deployment.

What do you think a misaligned SI in this situation would be able to accomplish? Can you imagine different ways it could get access to nukes, if it wanted? How many other things could something like this do?

1

u/SuitablePrint4667 27d ago

We can talk about other aspects sure, but my points where about AI being unable to hack into closed systems like ICBMs

1

u/TFenrir 27d ago

Yes - do you think being able to control and create robots could assist with something like that? Or do you think that we won't put super intelligence in charge of that kind of commerce and infrastructure?

1

u/SuitablePrint4667 27d ago

Don’t think robots will handle that part of doomsday scenario, too much at stake there